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NEAR-OPTIMUM  DETECTION  PERFORMANCE  OF  POWER-LAW 
PROCESSORS  FOR  RANDOM  SIGNALS  OF  UNKNOWN  LOCATIONS, 
STRUCTURE,  EXTENT,  AND  ARBITRARY  STRENGTHS 

INTRODUCTION 

This  technical  report  is  the  fifth  in  a  series  of  NUWC 
Division  Newport  publications  which  are  aimed  at  determining  the 
fundamental  performance  capability  of  detection  of  random  signals 
with  unknown  characteristics.  The  previous  four  reports  dealt 
mainly  with  the  case  of  equal  average  signal  power  levels  in  all 
the  occupied  bins;  this  report  extends  those  investigations  by 
addressing  the  important  case  of  arbitrary  (unequal)  signal 
powers  in  the  occupied  bins.  The  major  question  to  be  answered 
is.  Whether  the  same  power-law  processor  values  of  the  power  v 
should  be  used  in  order  to  reach  performance  levels  in  the 
neighborhood  of  those  for  the  optimum  processor?  Also,  the  exact 
losses  of  the  power-law  class  of  processors,  for  various  numbers 
of  occupied  bins  and  different  sets  of  signal  strengths,  are  of 
interest.  The  principal  motive  is  the  need  to  detect 
intermittent  signals  that  occur  in  random  locations  with  no 
apparent  structure  and  with  arbitrary  strengths,  time  intervals, 
and/or  frequency  extents. 

As  shown  in  [1;  pages  23  -  30],  it  is  necessary  to  introduce 
an  unrealistic  optimum  processor  in  order  to  determine  a  limiting 
bound  on  performance.  However,  to  keep  this  bound  as  tight  as 
possible,  it  is  also  necessary  to  find  the  worst  possible 
(unrealistic)  optimum  processor.  The  simple  banding  procedure 
employed  in  [1]  no  longer  suffices  now,  when  the  variation  in  the 
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set  of  signal  powers  is  large.  Instead,  a  pairing  procedure 
within  bands  of  different  sizes  must  be  employed;  the  numerical 
computational  procedure  accompanying  this  method  necessitates 
careful  manipulation  of  the  processing  equations  in  order  to 
preserve  significance  and  avoid  overflow.  As  a  result,  very 
tight  bounds  have  been  obtained,  which  indicate  that  the  power- 
law  processor,  with  proper  choice  of  power  v,  can  virtually 
optimally  detect  unequal  signals,  with  strengths  just  a  fraction 
of  a  decibel  greater  than  those  required  for  the  optimum 
processor. 

The  novel  method  presented  here  for  the  development  of  the 
power-law  class  of  processors  employs  a  top-down  design,  in  that 
the  optimum  (unrealistic)  processor  is  first  derived,  and  then 
modified  as  little  as  possible,  in  an  attempt  to  keep  the  signal 
detectability  near  optimum  and  yet  realize  a  practical  realistic 
processor  in  this  environment.  This  is  to  be  contrasted  with  the 
usual  bottom-up  design,  namely,  the  maximum  likelihood  approach, 
in  which  nothing  is  presumed  known  about  the  signal  parameters  or 
characteristics,  and  estimates  of  the  pertinent  parameters  are 
extracted  from  the  available  data  set  of  measurements.  The 
resultant  (in-bred)  generalized  likelihood  ratio  processor  has 
already  been  found  to  perform  poorer  than  the  power-law  processor 
by  several  decibels  in  this  unstructured  environment  [1,2, 3,4]. 
The  improvement  offered  by  the  top-down  design,  at  least  for  the 
particular  signal  detection  problem  considered  here,  suggests 
this  idea  as  a  candidate  approach  to  be  considered  for  other 
situations  as  well. 
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PROBLEM  DEFINITION 

The  search  space  consists  of  N  (frequency)  bins,  each 
containing  independent  identically  distributed  noises  of  unit 
power  under  hypothesis  Hq,  signal  absent.  This  situation  is 
presumed  to  be  accomplished  by  an  earlier  normalization 
procedure.  The  number  N  is  under  our  control  and  is  always  a 
known  quantity.  When  signal  is  absent,  the  probability  density 
function  of  each  of  the  N  bin  output  noises  is  completely  known. 

When  signal  is  present,  hypothesis  Hj^,  the  quantity  M  is  the 
actual  number  of  bins  occupied  by  the  signal;  this  is  frequently 
an  unknown  parameter.  The  quantity  L  is  the  actual  set  of  bins 
occupied  by  signal  components,  when  a  signal  is  present;  for 
example,  if  M  =  4,  then  we  might  have  L  =  {2,3,7,29}  for  the 
occupied  set,  meaning  that  bins  2, 3, 7, and  29  have  signal  in  them. 
This  quantity  L  is  always  unknown  in  our  investigation.  Finally, 
the  quantity  is  the  actual  average  signal  power  in  the  m-th 
occupied  bin  in  set  L,  when  a  signal  is  present;  the  average 
signal  powers,  {^}  for  1  <  m  <  M,  are  unknown  in  practice. 

Nothing  is  presumed  known  about  the  received  signal,  such  as 
it  being  deterministic;  rather,  the  signal  is  taken  to  be  random 
with  no  known  structure.  Thus,  for  example,  we  do  not  presume 
the  signal  to  be  a  collection  of  harmonics  of  unknown  fundamental 
frequency,  nor  do  we  insist  that  the  signal  occupy  a  contiguous 
band  of  frequencies  of  unknown  bandwidth  and/or  center  frequency. 
Instead,  the  signal  is  allowed  to  occupy  M  bins  of  the  search 
band  of  N  bins  in  an  unspecified  (nonoverlapping)  random  manner. 
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PROBABILITY  DENSITY  FUNCTIONS  OF  INDIVIDUAL  BIN  OUTPUTS 

We  now  Specify  the  detailed  character  of  the  probability 
density  functions  of  the  available  data,  namely,  qQ  and  under 
hypotheses  Hq  and  H^,  respectively.  In  both  hypotheses,  the  bin 
outputs  or  observations  are  taken  as  the  squared  envelopes 

of  the  outputs  of  (disjoint)  narrowband  filters  subject  to  a 
Gaussian  random  process  excitation;  alternatively,  the 
observations  can  be  interpreted  as  the  magnitude-squared  outputs 
of  a  fast  Fourier  transform  subject  to  a  Gaussian  process  input. 
It  is  assumed  that  these  magnitude-squared  bin  outputs,  that  is, 
random  variables  are  statistically  independent  of  each 

other,  which  is  consistent  with  the  frequency-disjoint 
requirement  and  a  Gaussian  process  excitation. 

Since  the  bin  output  noise  has  been  normalized  at  unit  mean 
level,  the  probability  density  function  of  the  n-th  observation 
is,  under  hypothesis  Hq,  an  exponential  of  the  form 

qo(Uj^)  =  exp(-Uj^)  for  u^^  >  0  ,  1  <  n  <  N  .  (1) 

On  the  other  hand,  when  signal  is  present,  hypothesis  Hj^, 
the  density  of  output  x^,  for  this  bin  occupied  by  the  m-th 
signal  with  average  signal  power  is  changed  to 

>  O  ,  nel..  (2) 

“"in 

Observe  that  the  actual  signal  power  per  bin,  can  also  be 

interpreted  as  the  actual  signal-to-noise  power  ratio  per  bin, 
since  the  noise  power  per  bin  has  been  normalized  at  unity. 
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OUTLINE  OF  APPROACH 

Solution  of  the  signal  detection  problem  posed  here  has  been 
achieved  by  a  five-pronged  approach.  First,  we  take  an 
unrealistic  position  and  determine  the  optimum  processor  for 
known  extent  M  and  signal  powers  Then,  due  to  the 

impossibility  of  realizing  this  particular  optimum  processor, 
approximations  are  developed  that  lead  to  the  class  of  power-law 
processors,  which  are  realistic  and  are  not  dependent  on  any 
information  unlikely  to  be  available  in  practice,  such  as  M  and 
Having  arrived  at  the  power-law  class  of  processors,  the 
level  of  their  detection  capability  is  addressed  next  and 
accurately  quantified  in  terms  of  their  false  alarm  and  detection 
probabilities,  P^  and  P^,  respectively.  This  naturally  leads  to 
the  question  of  the  loss  that  accompanies  this  approximation  and 
the  absolute  best  level  of  performance  that  can  be  attained  by 
any  processor  in  this  environment;  solution  of  this  very 
important  problem  requires  creation  and  derivation  of  a  new 
bounding  procedure  involving  banding  of  signals  and  pairing  of 
signals.  Finally,  a  quantitative  comparison  of  the  receiver 
operating  characteristics  of  the  power-law  processor  with  those 
for  the  absolute  best  processor  is  made;  this  allows  for 
determination  of  the  maximum  losses  that  are  incurred  by 
employing  this  practical  power-law  device  for  signal  detection. 
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DERIVATION  OF  OPTIMUM  PROCESSOR  FOR  RANDOM  SIGNALS  WITH  KNOWN 
EXTENT  AND  STRENGTHS  BUT  UNKNOWN  STRUCTURE  AND  LOCATIONS 


We  presume  that  the  number  of  bins  occupied  by  signal,  M,  and 
the  (arbitrary)  average  signal  powers,  {^}  for  1  <  m  <  M,  are 
known  to  the  (unrealistic)  optimum  processor,  but  that  the  actual 
locations  of  the  occupied  bins,  L,  are  completely  unknown,  random 
and  equally  likely  to  occur.  There  is  therefore  a  total  number  of 
possible  occupancy  patterns,  for  the  M  occupied  signal  bins,  of 


Kq  s  N  (N  -  1)  •••  (N  +  1  -  M)  ,  (3) 

each  of  which  possibilities  can  occur  with  equal  probability 
1/Kq.  For  future  reference,  we  define  the  strength  parameters 
{^}  and  weights  {v^}  according  to 


^  = 


1  +  ^ 


-m 


1  +  ^ 
—in 


for  1  <  m  <  M 


(4 


Under  hypothesis  Hq,  the  joint  probability  density  function 
governing  the  statistically  independent  members  of  observation 
{Xnl  (that  is,  the  magnitude-squared  fast  Fourier  transform 
outputs )  is  given  by 

N 

Pq(u^,...,Ujj)  =  rT{exp(-u^)}  for  all  u^^  >  0  .  (5) 

n=l 


On  the  other  hand,  under  hypothesis  H^^,  the  pertinent  joint 
probability  density  function  governing  observation  is 
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N  N  ^  rl  f  1 

Pi(^i'*’*'"n)  "*  ^  Ikq  ^1  ®*pI  -1  ^jj  ^ 


no  two  equal 


N 

X  a2  exp(-  £2  u J  ^  exp(-  ^  u^)  7Ttexp(-Uj^) } ]  ;  (6) 


the  "no  two  equal"  qualifier  under  the  summations  means  that  none 
of  the  integers  j,k/...,X  can  be  equal  to  each  other,  while  the 
slash  on  the  product  indicates  that  we  must  have  n  j,k,.../X. 
There  are  M  summations  in  (6),  with  a  total  of  Kq  terms. 

The  likelihood  ratio  for  observation  {x^}  is  therefore 


no  two  equal 


The  likelihood  ratio  test  follows  immediately  as 


N 


N 


N 


j=l  k=l  X=1 
no  two  equal 


exp 


(wi  X.  .  w. 


2  *k 


+  ^X 


(8) 


where  v  is  a  fixed  threshold.  There  is  a  total  of  Kq  terms  in 
these  M  summations;  for  large  N,  this  number  in  (3)  is  too  large 
to  make  optimum  processor  (8)  a  viable  processor.  Expression 
(8)  must  be  simplified  in  order  to  realize  a  practical  processor. 
Also,  M  and  {^1  are  required  to  be  known  in  order  to  realize 
(8);  these  drawbacks  obviate  the  use  of  (8)  as  a  practical 
alternative  for  detection  purposes. 
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SPECIAL  CASES 

As  a  very  special  case  of  (8)/  consider  N=2,  M=2;  then 
( 8 )  reduces  to 

exp(Wj^  +  W2  X2)  +  exp(Wj^  X2  +  W2  ^  v  .  (9) 

Despite  having  M  =  N  for  this  example,  the  optimum  processor  does 
not  simply  sum  the  data  values  Xj^  and  X2/  nor  does  it  linearly 
weight  and  sum  them  (unless  w^  “  H2'  that  is,  Sj^  ~  §.2)  •  Rather, 
weights  w^  and  W2  are  applied  to  each  of  the  two  possibilities 
where  the  two  different  signals  could  have  been  located,  each 
weighted  sum  is  exponentiated,  and  the  results  are  summed.  This 
immediate  deviation  from  linear  processing,  even  for  M  =  N,  leads 
us  to  anticipate  that  the  class  of  power-law  processors  will  have 
even  wider  applicability  in  the  case  of  unequal  signal  powers 
fS  )  than  in  the  case  of  equal  signal  powers  studied  in  [4].  For 
example,  v  =  1  may  no  longer  be  the  best  power  to  use  when  M  =  N. 

Another  special  case  is  afforded  by  setting  M  =  1  in  (8); 
there  follows  the  likelihood  ratio  test 

N  s 

ZIZ  exp(w,  X. )  V  .  (10) 

j=i  i  3  ^ 

This  is  the  same  form  as  encountered  earlier  in  [4;  (9)]  for 
equal  signal  powers,  because  for  M  =  1  there  is  only  one  signal 
power  of  relevance.  Numerical  detectability  results  for  M  =  1 
are  available  in  [4;  figures  A-1,  B-1,  C-1  for  v  *=  2,  3,  2.5, 
respectively].  Accordingly,  we  limit  consideration  to  M  >  2  here. 
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For  N  =  3,  M  =  2,  the  likelihood  ratio  test  in  (8)  becomes 


exp(Wj^  +  W2  X2)  +  exp(Wj  x^  +  W2  x^)  +  exp(Wj  X2  +  W2  Xj^)  + 

exp(w^  X2  +  W2  X3)  +  exp(w^  x^  +  W2  x^)  +  exp(Wj  x^  +  W2  ^2^  <  ^' 

(11) 

The  final  special  case  we  consider  is  N  =  3,  M  =  3,  for  which 
the  likelihood  ratio  test  is 


exp(Wj^  +  W2  X2  +  x^)  +  exp(Wj^  x^  +  W2  *2)  + 

+  exp(Wj^  X2  +  ^2  — 3  ^3 )  *2  — 2  ^3  ^  — 3  ^1^  ^ 

+  exp(w^  X3  +  W2  Xj^  +  W3  X2)  +  exp(Wj^  x^  +  W2  X2  +  W3  x^)  <  v  . 

(12) 

The  major  point  to  observe  in  these  special  cases  is  that  all 
possible  combinations  of  weights  with  data  values  {x^^}  are 

utilized  prior  to  exponentiation  and  summing.  When  the  correct 
pairing  of  weights  and  data  values  is  encountered  under  the 
exponential  greatly  accents  that  term,  tending  to  lead  to  the 
correct  decision  on  signal  presence. 

When  M  =  N,  there  is  a  total  of  Kq  =  N!  terms  in  the  N 
summations  in  (8).  The  extremely  large  size  of  N!  precludes 
realization  of  the  optimum  processor  in  this  case.  This  is  in 
marked  distinction  to  the  case  of  equal  signal  powers,  where 
(8)  simplifies,  due  to  the  equal  weights,  to  the  easily  realized 
likelihood  ratio  test 


(13) 


10 


TR  11123 


GAUSSIAN  INPUTS 

The  above  derivation  used  observations  {^^1/  which  were  the 
result  of  a  magnitude-squared  operation  on  the  complex  outputs  of 
a  fast  Fourier  transform  or  were  the  envelope -squared  outputs  of 
a  bank  of  narrowband  filters  subject  to  a  Gaussian  input 
excitation.  This  resulted  in  the  exponential  probability  density 
functions  employed  in  ( 5 )  and  ( 6 ) . 

The  question  arises  as  to  how  the  optimum  processing  would 

differ  if  the  in-phase  and  quadrature  components  that  led 

2  2 

to  data  value  x^^  were  retained  instead;  that  is,  *n  ~  ^n  ^  *^n* 
Here,  the  in-phase  and  quadrature  components  g^^  and  h^^  will  both 
be  zero-mean  Gaussian  random  variables  with  a  common  standard 
deviation  (a^  =  1//2  for  Hq,  >  Uq  for  H^),  as  well  as  being 

uncorrelated  with  each  other.  This  means  that  there  is  no 
information  relative  to  signal  presence  contained  in  the  phase  of 
+  i  h^,  but,  instead,  the  information  resides  only  in  the 
magnitude  of  the  complex  random  quantity  z^.  This  means  that 
there  is  no  loss  in  generality  or  processing  capability  by 
immediately  reverting  to  the  magnitude -squared  operation 
Xn  =  iS/  the  optimum  data  processing  for  the  Gaussian 

situation  is  identical  to  that  derived  above,  starting  with  the 
magnitude-squared  variables  (This  conclusion  has  also  been 

verified  by  direct  manipulation  of  the  Gaussian  statistics  of  the 
in-phase  and  quadrature  variables  only  the  combination 

+  h^  occurs  in  the  probability  density  functions  and 
likelihood  ratio. ) 


11/12 

Reverse  Blank 


TR  11123 


POWER  SERIES  EXPANSION  OF  THE  OPTIMUM  PROCESSOR 

The  optimum  processor  for  unknown  signal  structure  and 
occupied  bin  locations  is  given  by  ( 8 ) .  This  form  is  impractical 
for  numerical  calculations  when  N  is  large;  accordingly,  we 
attempt  to  manipulate  (8)  into  a  useful  numerical  form.  For 
M  =  1,  this  likelihood  ratio  test  reduces  to 

N  > 

5  !  exp(w^  X  )  ^  V  ,  (14) 

n=l 

which  can  be  easily  realized  and  simulated.  Therefore,  we 
confine  the  following  analysis  to  M  >  2. 

If  we  denote  the  argument  of  the  exponential  in  (8)  by 

X  s  Wj^  Xj  +  W2  *k  ^ 

its  power  series  expansion  yields  the  likelihood  ratio  test  in 
the  form 

C  C  •••  C  (l  +  X  +  I  +...]>  V  ,  (16) 

no  two  equal 

where  there  are  M  summations.  The  constant  1  leads  to  a 
summation  value  of  Kq.  We  now  consider  and  simplify  the  next 
three  terms  in  this  expansion. 
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LINEAR  COMPONENT  OF  OPTIMUM  PROCESSOR 

The  linear  term  in  expansion  (16)  is,  using  (15), 


no  two  equal 


(17) 


Since  random  variable  is  linear  in  both  the  weights  {\^1  and 
the  data  {x  },  and  since  the  M-fold  sum  treats  every  variable 
equally,  it  can  be  simplified  to  the  exact  result 

Ql  =  ,  (18) 

where 


Kj  =  (N-1) (N-2 ) • • • (N+l-M) 


and 


M 


in=l 


--in 


N 


(19) 


(20) 


Compact  result  (18)  is  very  simple  and  quick  to  execute  and 
evaluate  numerically.  Notice  that  the  simple  linear  sum  of 
all  the  data  values  is  the  relevant  data  statistic  to  first 

order . 
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QUADRATIC  COMPONENT  OF  OPTIMUM  PROCESSOR 


The  quadratic  term  in  expansion  (16)  is 


N  N  N  / 

Qo  =  m  c  m  Ui 

^  j=l  k=l  X=1  ^  J  ^  ^ 


(21) 


no  two  equal 


But,  since  Q2  is  quadratic  in  the  data  must  have  exactly 


Q2  =  ^2  T2  +  B2  Tj  , 


(22) 


where  we  define 


T  s 


N 

5^^ 


M 


(23) 


It  should  be  observed  that  only  N  of  the  quantities  JT^}  for 
V  =  1/2,3,...  are  independent  and  that  only  M  of  the  quantities 
{Wj^l  for  k  =  1,2,3,...  are  independent.  For  example,  we  have 


.  i  Ti  (3  Tj  -  tJ]  lor  H  -  2 


(24) 


and 


W3  =  Wi  (3  W2  -  W^]  for  M  =  2  . 


(25) 


In  general,  in  order  to  solve  for  coefficients  A2  and  B2,  we 


first  set  all  data  values  x^  =  1,  obtaining  for  (21)  and  (22) 
N(N-l) • • • (N+l-M)  =  A2  N  +  B2  N^  . 


(26) 


On  the  other  hand,  setting  data  value  x^  =  1,  and  all  other 
x^  =  0,  there  follows  for  (21)  and  (22) 
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W2  (N-1) (N-2) •• -(N+l-M)  =  A2  +  B2  . 

The  solutions  to  (26)  and  (27)  are 

A2  =  K2  (n  W2  -  w2)  ,  B2  =  K2  (w2  -  W2)  , 


(27) 


(28) 


where  we  have  defined 


K2  s  (N-2) (N-3) ••• (N+l-M)  for  N  >  M  >  3  ;  (29) 


also,  K2  =  1  for  N  >  M  =  2.  Since  the  data  {x^^}  is  never 

2 

negative,  we  always  have  >  ^2'  except  when  only  one  weight 
is  nonzero.  Also, 


w"  = 


M 


[ni=l 


<  M  W2  ^  N  W2 


(30) 


with  equality  holding  only  when  all  the  weights  are  equal  and 

when  M  =  N.  Thus,  A2  and  B2  in  (28)  and  (22)  are  nonnegative. 

Numerical  investigation  of  A2  and  B2,  for  different  values  of 

2 

M  and  weight  structures  {v^}/  reveals  that  both  terms  T2  and 

in  (22)  are  influential  in  determining  the  value  of  Q2  when 

there  is  substantial  variation  in  the  weights.  However,  if  all 

2 

the  weights  are  approximately  equal,  then  the  T^  term  is  the 
dominant  one  in  (22).  Thus,  there  is  a  transitional  behavior  for 
Q2  in  the  use  of  the  general  power-law  processor  T^,  defined  in 
(23),  as  the  weight  structure  and  its  size  M  varies.  (The  best 
choice  of  v  will  have  to  wait  for  detailed  receiver  operating 
characteristics  of  the  power-law  class  of  processors.)  Observe 
that  processor  does  not  need  to  know  or  use  M  or  . 
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CUBIC  COMPONENT  OF  OPTIMUM  PROCESSOR 

We  presume  that  M  >  3  in  this  subsection;  the  special  case  of 
M  =  2  is  treated  separately.  The  cubic  term  in  expansion  (16) 
is,  using  (15), 

N  N  N  ,  ^3 

Q3  ^  •••  IZ  (wi  +  W2  •••  +  % 

no  two  equal 

But,  since  Q3  is  cubic  in  the  data  we  must  have  exactly 

Q3  =  A3  T3  +  B3  T2  +  C3  .  (32) 

In  order  to  determine  coefficients  A3,  B3,  and  C3,  we  first 
set  all  =  1,  obtaining  for  (31)  and  (32) 

Wj  N(N-l) • • • (N+l-M)  =  A3  N  +  B3  N^  +  C3  N^  .  (33) 

On  the  other  hand,  with  Xj^  =  1  and  all  other  =  0,  we  obtain 
for  (31)  and  (32) 

W3  (N-1) •••(N+l-M)  =  A3  +  B3  +  C3  .  (34) 

Finally,  with  x^  =  1,  X2  =  1,  and  all  other  x^  =  0,  there  follows 
for  (31)  and  (32) 

[W3  (2N-8)  +  W2  e] (N-2)^-- (N+l-M)  =  A3  2  +  B3  4  +  C3  8  .  (35) 

The  solutions  to  these  last  three  linear  equations  are 
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^3  “  ^3  (^3  ■  ^2  ^1  '^l  ' 

B3  =  K3  [-W3  N  +  W2  W^  (N+1)  -  W3]  3  , 

C3  =  K3  (  W3  2  -  Wj  Wj  3  +  wj]  , 


(36) 


where  we  have  defined 

K3  =  (N-3) (N-4) • • • (N+l-M)  for  N  >  M  >  4  ;  (37) 

also,  K3  s  1  for  N  >  M  =  3.  The  results  in  (36)  reduce  to  a 
scaled  version  of  [4;  (18)  -  (19)]  when  all  the  weights  {Wj^^}  are 
equal.  In  the  special  case  of  N  >  M  =  2,  we  find 


Q3  =  (N-1)  (wj  +  w^)  T3  +  3  w^  W2  (w^  +  W2)  (^1  **^2  "  ^3)  • 


Numerical  investigation  of  coefficients  A3,  B3,  and  C3,  for 
different  values  of  M  and  weight  structures  {v^}/  reveals  that 
the  last  term  in  (32)  is  dominant  when  all  the  weights  are  equal 
and  when  M  >  10  approximately.  On  the  other  hand,  when  there  is 
significant  weight  structure  variation,  the  last  term  in  (32)  is 
the  least  significant.  Thus,  as  the  weight  structure  and  its 
size  M  varies,  there  is  a  transitional  behavior  for  Q3  in  the  use 
of  the  members  of  the  class  of  power-law  processors  T^  and  the 
particular  power  v;  this  observation  is  consistent  with  [4]. 
Again,  the  best  choice  of  v  cannot  be  made  without  determining 
the  receiver  operating  characteristics.  However,  there  is  no 
need  to  know  M  or  in  order  to  realize  processor  T^. 
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APPROXIMATE  LIKELIHOOD  RATIO  TEST 

When  definitions  (17),  (21),  and  (31)  are  employed  in  (16), 
the  power  series  expansion  of  likelihood  ratio  test  (8)  becomes 

Kq  +  Qi  +  §  Q2  +  f  Q3  +  • • *  <  V  ,  (39) 

where  Qj^,  Q2/  and  are  given  by  (18),  (22),  and  (32), 
respectively.  These  quantities  are  quickly  and  easily  evaluated 
from  the  data  (x  }.  If  the  infinite  series  in  (39)  is  terminated 
with  the  term,  for  example,  we  obtain  an  approximate 
likelihood  ratio  test,  which  could  easily  be  computed;  this  is  in 
sharp  contrast  with  the  original  exact  likelihood  ratio  test  (8). 
However,  the  terminated  version  of  test  (39)  would  not  perform  as 
well  as  test  (8),  since  (8)  is  the  optimum  processor. 
Nevertheless,  terminated  versions  of  expansion  (39)  might  be 
useful  in  estimating  the  performance  of  the  likelihood  ratio 
processor  (8),  which  itself  cannot  be  simulated  for  even  one 
trial  when  N  is  large.  This  route  for  determining  the 
performance  of  the  likelihood  ratio  processor  (8)  has  not  been 
pursued  any  further;  as  one  cautionary  note,  the  approach  of 
terminated  versions  of  (39)  to  optimality  may  not  be  monotonic  in 
the  number  of  terms  retained. 
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SPECIAL  CASE  OF  EQUAL  SIGNAL  POWERS 

When  all  the  signal  powers  {^}  are  equal  to  a  common  value 
S,  all  the  weights  {^}  reduce  to  common  value  w  =  S/(l  +  S) . 
Then,  (23)  yields  Wj^  =  M  w^,  and  the  terms  in  (39)  simplify  to 

Ql  =  Kj  M  w  , 

Qj  =  Kj  M  (b22  Tj  +  T^)  , 

Qj  -  Kj  M  [bjj  Tj  +  b32  T2  Tj  +  bjj  tJ)  ,  (40) 

where  coefficients 

N-M  M-1 

^22  ^  '  ^21  ^  N^ 

and 

N-M  N-2M  M-1  N-M  M-1  M-2 

^33  "  nTT"  '  ^32  "  ^  iTT  N^  '  ^31  "  N^  N^  * 

Observe  that  the  sum  of  the  coefficients  in  (41)  is  equal  to  1, 
as  is  the  sum  of  the  coefficients  in  (42).  These  results  confirm 
those  in  [4;  pages  9  -  14]. 
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EXTRACTION  OF  THE  POWER-LAW  CLASS  OF  PROCESSORS 


The  expansion  of  the  general  likelihood  ratio  test  in  (39) 
can  be  developed  in  more  detail  in  terms  of  the  power-law  sum  T^ 
defined  in  (23).  Namely,  the  sufficient  statistic  is 


^0  ^1  ^1  ,^22  '^2  ^21  ’^l; 


^33  ^^3  *^32  ’^2  ’^l  ^31  ^1 


+  b44  +  b43  T3  T3  +  b,2  tI  -K  b43  13  +  b^^  + 


(43) 


This  expansion  suggests  (but  does  not  directly  imply)  the 
consideration  of  processor  T^  itself,  for  various  v,  as  a 
decision  variable  in  practical  situations  where  coefficients 
{bknl  unknown.  The  dependence  of  the  resultant  processor  on 

the  unknown  number  of  occupied  bins  M  and  the  unknown  weights 
{^}  (that  is,  signal  powers  {^} )  is  thereby  eliminated. 

However,  this  abrupt  selection  constitutes  a  significant  break  in 
the  continuity  of  the  analysis  of  the  optimum  processor  and  could 
lead  to  severely  degraded  performance. 

If,  instead,  we  were  to  attempt  to  keep  groups  of  terms  to  a 
particular  order,  they  would  have  to  be  weighted  in  accordance 
with  information  that  is  not  available  in  practice.  Thus,  this 
step  of  adoption  of  the  power-law  processor  is  a  crude  but 
necessary  one  for  realizing  a  practical  realistic  processor,  and 
one  that  cannot  be  avoided  in  our  approach  to  the  detection 
problem.  It  is  mandatory  at  some  point  to  face  the  issue  of 
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eliminating  dependence  on  signal  parameters  that  were  assumed, 
but  are,  in  reality,  unknown.  Furthermore,  there  is  little 
guidance  available  in  making  this  most  crucial  step  in  deriving  a 
viable  practical  processor;  some  considerable  amount  of  trial  and 
error  would  probably  be  involved  in  most  circumstances. 
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PERFORMANCE  OF  POWER-LAW  PROCESSORS 


Integer  M  is  the  actual  number  of  bins  occupied  by  signal 
components,  quantities  {^1  for  1  <  m  <  M  are  the  actual 
(arbitrary)  values  of  the  average  signal  powers  in  the  M  occupied 
bins,  and  L  is  the  actual  set  of  M  occupied  bins.  All  these 
quantities  are  considered  unknown  to  our  practical  signal 
processor,  namely,  the  power-law  processor. 

Given  observation  for  1  <  n  <  N,  the  power-law  processor 

will  be  used  for  signal  detection.  Its  decision  variable  is 


z 


(44) 


This  processor  is  to  be  used  regardless  of  the  actual  (unknown) 
values  of  M,  and  L.  Through  proper  choice  of  the  power  v, 

we  will  show  that  the  performance  of  this  power-law  processor  is 
very  close  to  the  optimum  processor,  (8),  which  knows  and  uses 
M  and  {^}/  but  also  lacks  knowledge  of  occupied  set  L. 

For  future  use,  we  define  the  function 

CD 

h^(a)  =  J  dt  exp|-  t  +  iat^j  ,  v  >  0  ,  (45) 

0 

for  all  real  a.  Then,  under  hypothesis  Hq,  the  characteristic 
function  of  decision  variable  z  in  (44)  is  given,  for  real  by 
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f°(5)  s  exp(i5z)  =  TJ  expfiUjj]  = 
z  n=l  ^ 

<X>  m-r 

Nr  r  r 

=  II  J  du  exp(-u)  exp^i^u  =  h^(^)J  .  (46) 

n=l  J 

On  the  other  hand,  under  hypothesis  the  characteristic 

function  of  the  m-th  (signal)  term  in  (44)  is,  by  (2)  and  (4), 

00 

exp(ijx;j)  =  I  du  exp(-  a_^u)  exp(iEu'’)  -  •  («) 

0 

This  yields  the  characteristic  function  of  decision  variable  z  in 
(44),  under  hypothesis  H^,  in  the  form 

f^(E)  *  KiE)]"”  'TT \(e  (i+s„)'’)  ' 

Ill=l 

regardless  of  which  set  of  bins,  L,  is  actually  occupied.  Thus, 
for  both  hypotheses  Hq  and  Hj^,  the  major  effort  centers  around 
determining  the  function  h^(a)  defined  in  (45). 

For  small  a,  we  obtain  directly  from  (45)  the  behavior 

h^(a)  ~  1  +  ia  r(v+l)  as  a  0  .  (49) 

This  result  can  be  used  to  find  the  behavior  of  (48)  for  small 
I,  which  enables  exact  determination  of  the  mean  of  z  under 
hypothesis  in  the  form 

f  -  1 

^J  =  r(V+l)  N  -  M  +  YU 
^  m=l  ; 
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Plots  of  false  alarm  probability  versus  threshold  v 
are  already  available  for  v  =  1  in  [2;  figure  50]  and  for 
V  =  2,  3,  2.5  in  [4;  figures  1,  2,  3  respectively]. 

Observe  from  (49)  that  h^(0)  =  1,  independent  of  v.  And, 
from  (45),  we  have  immediately 

hi  (a)  =  ^  for  all  real  a  .  (51) 


Also,  by  means  of  [5;  chapter  7],  we  have 


h2(a) 


(1+i) 


for  a  >  0  , 


(52) 


where  w(  )  is  the  error  function  of  complex  argument.  Finally, 
for  V  =  *5,  there  follows,  in  a  similar  fashion. 


hijCoc) 


=  1  +  i  n 


!“(§) 


for  all  real  a 


(53) 


Major  interest  in  power-law  processor  (44)  will  center  around 
values  of  \)  in  the  range  1  to  3;  see  [4].  However,  for 
completeness  and  for  application  to  very  small  values  of  M, 
results  for  the  limiting  case  of  v  =  “  will  be  presented  first. 
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MAXIMUM  PROCESSOR,  v  =  “> 

As  V  tends  to  infinity,  the  performance  of  the  power-law 
processor  in  (44)  tends  towards  that  of  the  maximum  processor, 

2  =  max{x^,...,Xjj}.  (Strictly,  the  variable  in  (44)  tends 

to  the  maximum  variable  as  v  however,  the  power  can  be 

absorbed  in  a  modified  threshold  v,  with  no  change  in  detection 
performance.)  Using  the  statistical  independence  of  all  the 
random  variables  the  cumulative  distribution  function  of 

the  maximum  variable  z  is 

N 

C  (V)  =  Pr(z  <  V)  =  TT 
^  n=l 

Therefore,  the  exceedance  distribution  function  of  z  under 
hypothesis  Hq,  namely,  the  false  alarm  probability  P^,  is 

E°(v)  =  1  -  [1  -  exp(-v)]^  for  v  >  0  ,  (55) 

z 

which  is  easily  computed.  On  the  other  hand,  under  hypothesis 
H^,  the  exceedance  distribution  function  of  z,  namely,  the 
detection  probability  P^,  is 

M 

E  (V)  =  1  -  [1  -  exp(-v)]”~-  TTll  -  exp(-^v)}  for  v  >  0  .  (56) 
^  m=i 

These  results  generalize  those  given  in  [3;  (30)  -  (33)]. 

Receiver  operating  characteristics  for  this  case  of  v  =  »  can  be 
readily  obtained  directly  from  (55)  and  (56),  for  any  N,  M,  and 
set  of  signal  powers  {^}  of  interest. 
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LINEAR-LAW  PROCESSOR,  V  =  1 

Here,  we  consider  power-law  v  =  1  in  test  (44).  Then,  under 
hypothesis  Hq,  the  characteristic  function  of  decision  variable  z 
is  given,  by  reference  to  (46)  and  (51),  as 

f°(5)  =  [h,(?;)]”  =  - - - ij  • 

z  1  (1  _  i5)N 

The  corresponding  false  alarm  probability  is 

^  1  k 

=  Pr(z  >  v|Hf,)  =  exp(-v)  >  ^  rry  V  for  v  >  0  .  (58) 

^  ^  k=0 

Plots  of  Pj  versus  threshold  v  are  available  in  [2;  figure  50]. 

On  the  other  hand,  under  hypothesis  the  characteristic 
function  of  z  is,  by  reference  to  (48)  and  (51), 

f^(5) - 1 -  .  (59) 

(1  -  u)”"-  rT(i  -  «(i+s„)) 


These  results  generalize  those  given  in  [2;  pages  21  -  22]. 
Receiver  operating  characteristics  can  be  obtained  from  (58)  and 
(59)  by  employing  the  techniques  in  [6]  for  evaluating  the 
exceedance  distribution  function  P^  directly  from  the 
characteristic  function  (59).  The  mean  of  z  under  hypothesis 
is  obtained  by  setting  v  =  1  in  (50),  yielding 


M 


IZ 

m=l 


S 

— ra 


(60) 
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QUADRATIC-LAW  PROCESSOR,  v  =  2 


In  this  subsection,  we  consider  v  =  2  in  power-law  processor 
(44).  The  characteristic  function  of  decision  variable  z  under 
hypothesis  Hq  is,  by  reference  to  (46)  and  (52), 


f°(S)  =  [h2(0]” 


(1+i) 


w 


-1+i 


N 


for  5  >  0  , 


(61) 


where  w(  )  is  the  error  function  of  complex  argument.  Plots  of 
false  alarm  probability  P^  are  available  in  [4;  figure  1]. 

On  the  other  hand,  under  hypothesis  Hj^,  the  characteristic 
function  of  z  is,  by  reference  to  (48), 

M 

f^(0  =  [h2(5)]^"-  TT 


where  function  h2(a)  is  given  by  (52).  These  results  generalize 
those  in  [4;  pages  15  -  16].  Availability  of  an  accurate 
computer  routine  for  the  error  function  of  complex  argument, 
w(  ) ,  enables  ready  determination  of  the  receiver  operating 
characteristics  of  the  quadratic-law  processor  through  employment 
of  the  procedure  in  [6].  The  mean  of  z  under  hypothesis  is 
obtained  by  setting  v  =  2  in  (50),  resulting  in 


(63) 
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GENERAL  \)TH-LAW  PROCESSOR 

The  decision  variable  z  in  this  case  is  given  by  (44).  The 
general  characteristic  functions  of  z  have  been  given  by  (46)  and 
(48)  under  hypotheses  Hq  and  respectively.  The  mean  of  z 
under  hypothesis  was  given  in  (50).  The  function  h^(a) 
defined  in  (45)  can  be  expressed,  for  a  >  0,  in  the  alternative 
form 

00 

h^(a)  =  J  dr  exp[-ar^  -  exp[^]r  +  •  (64) 

0 

Here,  we  moved  the  contour  in  the  t-plane  in  (45)  to  the  radial 
line  with  angle  ii/(2v)  radians,  and  then  made  the  change  of 
variable  t  =  r  exp[in/(2v ) ] .  Since  values  of  v  greater  than  1 
are  of  interest,  the  integral  on  real  r  in  (64)  has  more  rapid 
decay  than  the  original  integral  on  t  in  (45).  In  addition,  the 
oscillation  of  the  integrand  in  (64)  is  constant  with  r,  whereas 
the  oscillation  continually  increases  with  t  in  the  original 
integral  in  (45).  Thus,  (64)  is  computationally  advantageous. 
(For  V  =  2.5,  also  let  r  =  x  in  order  to  eliminate  the 
singularity  at  the  origin. ) 

The  characteristic  function  of  decision  variable  z  in  (44)  is 
given  by  (46)  under  hypothesis  Hq.  We  numerically  evaluate  it 
and  false  alarm  probability  directly,  with  the  aid  of  (64). 
Plots  of  Pj  versus  threshold  v  are  available  for  v  =  3  and  2.5  in 
[2;  figures  2  and  3,  respectively]. 
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However,  for  hypothesis  in  order  to  reduce  the 

computational  effort,  we  directly  simulate  the  vth-law  processor 
in  (44)  to  determine  the  detection  probability  P^;  this  mixed 
procedure  (analysis  for  and  simulation  for  P^)  is  generally 
adequate  for  P^  values  in  the  interval  from  0.5  to  0.99,  which  is 
our  detectability  range  of  major  interest. 
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OPTIMUM  BANDED  PROCESSOR  FOR  ARBITRARY  SIGNAL  POWERS 

The  optimum  processor  with  zero  knowledge  of  occupied  bin 
locations  L  cannot  be  realized  or  simulated,  due  to  the  excessive 
number  of  terms  that  must  be  evaluated;  see  (8)  and  (3). 
Accordingly,  just  for  purposes  of  deriving  a  bound  on  the 
performance  of  the  optimum  processor,  we  will  modify  the 
zero-knowledge  situation  to  an  alternative  one  where  there  is  a 
small  nonzero  amount  of  partial  knowledge  about  the  signal 
bin-occupancy  pattern,  namely,  a  banded  signal  structure.  The 
corresponding  optimum  banded  processor  that  operates  with  this 
partial  location  knowledge  must  perform  better  than  the  zero- 
location-knowledge  optimum  processor,  which  in  turn  always 
performs  better  than  the  (ad  hoc)  power-law  processor,  regardless 
of  its  choice  of  power  v.  That  is,  the  receiver  operating 
characteristic  for  the  partial-location-knowledge  optimum  banded 
processor  also  constitutes  an  upper  bound  on  detectability  for 
the  receiver  operating  characteristic  for  the  power-law 
processor. 

It  should  be  recognized  that  both  the  zero-knowledge  optimum 
processor  and  the  optimum  banded  processor  are  unrealistic  for 
practical  applications,  in  that  they  employ  information  not 
typically  available,  such  as  M  and  These  mathematical 

artifices  are  introduced  here  solely  for  purposes  of  determining 
an  upper  bound  on  performance  that  any  processor  can  achieve  in 
the  particular  environment  under  investigation. 
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OCCUPANCY  PATTERNS  FOR  UNEQUAL  SIGNAL  POWERS 


In  order  for  this  upper  bound  to  be  a  useful  tight  bound/  the 
amount  of  partial  knowledge  about  the  signal  occupancy  patterns 
must  be  kept  as  small  as  possible;  it  cannot  be  zero  because  of 
the  difficulty  of  realizing  the  corresponding  optimiim  processor, 
(8).  Since  we  can  inject  this  partial  location  knowledge  in 
absolutely  any  way  and  amount  that  we  please,  we  construct  the 
following  situation  for  the  optimum  banded  processor  to  operate 
in;  the  reason  for  adopting  this  particular  approach  will  become 
apparent  when  we  derive  the  likelihood  ratio  test  in  closed  form 
and  succeed  in  significantly  simplifying  it  for  simulation 
purposes. 

All  the  quantities  M  and  are  known  to  the  optimum  banded 

processor,  but  the  precise  set  of  bins  occupied  by  signals  in  one 
observation  is  known  only  in  a  particular  banded  sense.  In  order 
to  determine  the  allowed  signal  occupancy  patterns,  we  define  the 
set  of  quantities 


m 


s  N 


— m 


Si  +  S2 


+  s 


for  1  <  m  <  M 


(65) 


•M 


observe  that  the  sum  up  to  N.  Since  the  quantities  {F^} 

yielded  by  (65)  will  not  generally  be  integers,  we  round  these 
quantities  to  their  nearest  integers  then,  adjust  these 

latter  integers  slightly  if  necessary,  so  that  +  Fj^  =  N. 

At  the  same  time,  guarantee  that  F^^^  >  1  for  all  m;  when  there  is 
a  wide  variation  in  the  set  of  signal  powers  this  may 

require  some  readjustment  of  the  larger  F^  values.  (An 
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alternative,  more  general  technique  will  be  presented  later.) 

Now,  break  the  total  number  N  of  search  bins  into  M  disjoint 
bands,  denoted  by  B2,  •••,  B^^,  of  sizes  Fj^,  F2,  •••,  Fj^, 
respectively.  In  the  m-th  band  B^,  under  hypothesis  allow 
only  one  bin  to  be  occupied,  by  a  signal  of  power  with  equal 
probabilities  l/Fjjj  of  landing  in  any  of  the  F^^^  bins  in  this  band. 
Observe  that  the  "average  signal  power  per  bin"  is,  from  (65), 

s  s 

+  S2  +  •••  +  Sj^)  for  1  1  m  £  M  ;  (66) 

^  ^m 

that  is,  the  ratio  is  approximately  independent  of  the 

particular  band  number  m.  The  larger  signal  powers,  command 

larger  band  sizes,  F^,  according  to  (66),  thereby  requiring  a 
larger  search  in  those  bands,  which  adds  to  the  confusion  faced 
by  the  optimum  banded  processor.  This  fractionalization  (65)  of 
the  search  space  N  would  appear  to  be  the  least  advantageous  for 
the  optimum  banded  processor,  degrading  its  performance  and 
thereby  furnishing  a  tight  bound  on  attainable  performance. 

An  alternative,  where  the  signal  powers  in  (65)  were  all 

raised  to  the  fj-th  power,  was  also  considered,  for  the  values  of 
p=0.5,  1,  1.5,  and  2 .  The  tightest  bound  ( that  is ,  worst 
performance)  appeared  to  be  achieved  for  /j  =  1,  although  the 
discrepancies  were  not  very  large  in  the  few  cases  that  were 
investigated  numerically.  Accordingly,  further  consideration  has 
been  limited  solely  to  p  =  1. 
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OPTIMUM  BANDED  PROCESSOR  TEST 


The  optimum  banded  processor  for  this  situation  has  the  exact 
decision  rule  (which  is  derived  in  the  next  subsection): 


M 

TT 

m=l 


neB 


exp 


*n) 


m 


(67) 


In  its  expanded  version,  test  (67)  takes  the  form 


HZ  expfw^  X  ) 

HZ  exp[w2  X  ) 

•  •  • 

HZ  exp 

ineBj^  ^  Z 

lnEB2  Z 

[neB^ 

i 

V  .  (68) 


Likelihood  ratio  test  (68)  requires  a  total  of  N  exponential 
evaluations,  followed  by  N  -  M  additions  and  M  -  1 
multiplications,  for  a  total  of  N  -  1  operations  per  trial, 
independent  of  M.  Test  (68)  is  capable  of  simulation  in  a 
reasonable  amount  of  computer  time;  this  simplification  of  the 
likelihood  ratio  test  is  explicitly  due  to  our  deliberate 
introduction  of  the  M  disjoint  bands  The  selection  of  the 

band  sizes,  or  in  (65),  is  done  for  a  different  reason, 

namely,  to  degrade  the  performance  of  this  optimum  banded 
processor  as  much  as  possible,  thereby  achieving  a  tight  bound  on 
performance. 

As  a  special  case,  for  M  =  N,  suppose  we  take  band  size 

F  =  1  for  all  m;  then,  test  (68)  reduces  to  the  linearly 
m 

weighted  sum 


N 


-n 


X 


n 


> 

< 


V  . 


(69) 
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This  particular  optimum  banded  processor  in  (69)  can  be  easily 
analyzed  in  terms  of  its  characteristic  functions  for  both 
hypotheses  Hq  and  Whether  this  processor  in  (69)  yields  a 

sufficiently  tight  bound  on  the  power-law  processors  for  M  =  N 
will  depend  on  the  particular  distribution  of  signal  power  values 
{^};  it  is  believed  that  (69)  will  be  a  good  comparison  case, 
except  when  the  signal  powers  are  rather  different  from  each 
other.  In  this  situation,  we  could  take  band  sizes  {Fjjjl 
according  to  (65)  and  then  employ  the  rounding  procedure 
described  earlier. 

An  example  for  N  =  1024,  M  =  4,  and  1^1  =  7,  6,  5,  4  dB 
yields  the  following  results.  From  (65), 

{F  }  =  349.91,  277.94,  220.78,  175.37; 

‘  m’ 

{F^}  =  350,  278,  221,  175;  sum  =  1024.  (70) 

In  this  case,  rounding  of  {F^}  yields  a  set  of  integers  {Fjjj}, 
which  still  add  up  to  N  =  1024,  so  that  no  further  modification 
is  needed. 
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DERIVATION  OF  OPTIMUM  BANDED  PROCESSOR 

Under  hypothesis  Hq,  the  joint  probability  density  function 
governing  the  observation  {x^}  is,  as  usual, 

N 

Pq(u^,...,Ujj)  =  ■n’{exp(-Uj^)  }  for  u^^  >  0  ,  (71) 

n=l 

where  we  have  utilized  the  statistical  independence  of  the 
individual  members  of  observation 

Under  hypothesis  let  us  assume  for  the  moment  that  bin  j 
is  occupied  in  band  of  size  Fj^;  bin  k  is  occupied  in  band  B2 
of  size  F2,...;  and  bin  X  is  occupied  in  band  B^^  of  size  F^^. 

We  also  require  that  signal  m  be  located  somewhere  in  band 
for  1  <  m  <  M  and  that  all  the  bands  be  disjoint.  Then, 

since  there  is  a  total  number  of 

F  H  F2  •••  F^  (72) 

possibilities  for  the  occupancy  patterns,  all  assumed  equally 
likely,  the  joint  probability  density  function  governing  the 
observation  {x^}  is,  for  this  particular  condition, 

f  a^  exp(-aj  u^)  exp(-a2  uj  ^  exp(-a^  u^]  R(j,k,...,X)  , 

(73) 

where  remainder  R(j,k,...,X)  contains  all  the  {exp(-u^)}  terms 
not  accounted  for,  namely, 

R(j,k,...,X)  =77  exp(-u  )  77  exp(-u  )  •••  77  exp(-u  ).  (74) 

msB^ 

m5^j  n^k  p^X 
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The  joint  probability  density  function  governing  the 
observation  under  hypothesis  is  therefore 


The  likelihood  ratio  of  the  observation  {x^^}  is  given  by 


?!  f  •  •  •  ) 

pQ  ^*1 ' ‘ ^ 


^1  ^2  **•  ^ 


F 


X 


X  explw2 


(76) 


The  likelihood  ratio  test  is  therefore 


m  iz 

jeBj^  ^^^2 


(77) 


There  is  a  total  of  F  terms  in  this  M-fold  sum;  see  (72). 
However,  when  each  of  the  summations  is  moved  to  the  appropriate 
term  in  the  M-fold  product,  the  end  result  for  the  likelihood 
ratio  test  may  be  written  in  the  much  more  economical  exact  form 


f  1 

/  N 

EZ  e*p|Hi  ='i) 

ZZ  exp  w,  Xj^ 

•  •  • 

EZ  exp  x^ 

IjtB,  ^  1  3JJ 

lksB2  ^  ^ 

IxeB„  '  -  ’] 

An  alternative  more  compact  expression  for  (78)  is 
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M 


This  is  the  result  quoted  earlier  in  (67). 
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OPTIMUM  BANDED  PROCESSOR  WITH  PAIRING 

A  problem  arises  with  the  procedure  given  in  the  previous 
section  when  the  variation  of  the  M  average  signal  powers  {^}  is 
significant,  that  is,  when  max{^}  >>  min{^}.  In  particular, 
when  the  quantities  in  (65)  are  rounded  to  their  nearest 

integers  some  (many)  of  these  latter  integers  can  turn  out 

to  be  zero.  This  means  that  the  corresponding  (weak)  signals 
receive  no  representation  in  terms  of  a  band  assigned  to  them. 
This  drawback  of  the  assignment  procedure  will  naturally  be  taken 
advantage  of  by  the  optimum  banded  processor,  which  will 
automatically  restrict  its  search  only  to  those  fewer  bands  where 
it  knows  that  signals  can  occur.  The  upshot  is  that  the 
performance  of  the  optimum  banded  processor  improves,  thereby 
weakening  the  desired  tight  upper  bound  that  is  desired.  In 
order  to  prevent  this  improvement,  we  must  create  a  signal 
assignment  which  leads  to  more  confusion  for  the  optimum  banded 
processor;  that  is,  we  are  trying  to  set  up  a  signal  arrangement 
which  will  lead  to  the  worst  possible  optimum  banded  processor. 
This  prompts  the  creation  of  the  following  pairing  procedure. 
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PAIRING  PROCEDURE 


In  order  to  circumvent  this  assignment  shortcoming  and  to 
tighten  the  bound,  a  pairing  procedure  has  been  devised.  Without 
loss  of  generality,  we  assume  that  the  signal  powers  {^}  have 
been  arranged  in  descending  order: 

li  i  12  i  •••  i  Sj,  >  0  .  (80) 


(This  ordering  has  nothing  to  do  with  where  the  signals  are 
actually  located  in  practice,  which  is  still  random  and 
nonoverlapping;  this  assumption  (80)  is  used  only  in  the  optimum 
processor  for  purposes  of  deriving  a  bound. )  Then,  we  pair  up 
the  strongest  and  weakest  signals  according  to  the  power  sums 


=  Si 


=  ^2 


^-1' 


M 


^  ^+1' 


(81) 


where  it  is  presumed  that  M  is  even. 

This  procedure  significantly  reduces  the  ratio  of  modified 
powers,  max{T^}/min{Tjjj} ,  so  that  all  the  signals  can  get  some 
representation.  For  example,  consider  a  signal  power  set 
which  varies  linearly  over  a  20  dB  range,  say  100  to  1.  Then, 

Tj^  =  100  +  1  while  Tj^  =  10  +  10,  which  yields  a  new  power  ratio 
of  5,  or  7  dB.  Thus,  a  reduction  of  13  dB  in  power  variation  is 
realized  for  this  example. 

Now,  we  form  M  =  M/2  bands,  with  band  sizes  proportional 

to  power  sums  {T^^}  instead  of  original  powers  {^};  that  is, 
similar  to  (65),  we  define  the  set  of  quantities 
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^  «  T,  4.  T,  I”*---  H-  T„  for  1  S  m  S  M  =  ^  .  (82) 

1  z  M 

Observe  that  the  sum  up  to  N.  Then,  we  round  these 

quantities  to  their  nearest  integers  and  modify  them,  if 

necessary,  so  that  they  again  sum  to  N;  Fj^  +  F2  +  *••  +  Fj^  =  N. 
Also,  we  insist  on  F^^^  >  2  for  all  1  <  m  i  M,  so  that  there  will 
always  be  guaranteed  representation  for  all  signal  pairs, 
regardless  of  their  total  strengths.  This  may  require  further 
modification  of  the  values  of  integers  {F^^^}  for  the  strongest 
pairs. 

We  now  have  M  bands  of  sizes  denote  them  by 

respectively,  for  1  <  m  <  M  =  M/2.  Then,  just  as  in  the  power 
combination  in  (81),  signal  pair  1  and  M  are  assigned  to  band  Bj^, 
signal  pair  2  and  M  -  1  are  assigned  to  band  B2,  and  signal  pair 
M  and  M  +  1  are  assigned  to  band  Bj^.  Furthermore,  within  each 
band  B^^,  each  pair  of  signals  (when  present)  can  occur  equally 
likely  in  the  F  bins  in  this  band  B^,  but  can  never  overlap  each 
other  in  the  same  bin.  (This  nonoverlapping  condition  will  be 
recognized  to  be  exactly  the  same  situation  for  signal  locations 
as  when  we  had  the  special  case  of  M  =  2;  in  fact,  we  are  using 
that  case  as  a  "building  block"  for  the  more  general  case  of 
large  M  where  we  must  employ  pairing.) 
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DERIVATION  OF  OPTIMUM  BANDED  PROCESSOR  WITH  PAIRING 


The  optimum  banded  processor  with  pairing,  to  be  denoted 
OPT-P,  does  the  usual  exhaustive  search  over  all  the  possible 
combinations,  now  taking  into  account  that  there  are  M  disjoint 
bands  {B  }  of  sizes  (F„},  each  with  two  signals,  instead  of  one. 
That  is,  similar  to  (78),  the  decision  rule  for  the  OPT-P  is 

exp(i^  X.  + 

:,kEB„ 

where  the  slash  on  each  summation  means  that  we  must  have  j  k. 

In  the  m-th  band  B^^^,  there  are  -  1)  possibilities  for 

the  pair  of  subscripts  j,k;  since  m  can  range  from  1  to  M  =  M/2, 
the  total  number  of  possibilities  can  become  a  large  number  when 
the  search  range  N  and  the  number  of  signals  M  are  large.  In 
order  to  simplify  the  calculations,  notice  that 


j/kEB„ 


=  (zz  «j)  (zz  -  IZ 

M  c-ia  J '  '•VcR  pR 


(84) 


which  requires  consideration  of  only  2  F^^  possibilities.  Thus, 
for  example,  the  first  term  in  (83)  can  be  expressed  as 
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where  we  have  defined 

e  =  expfw  x„]  for  lim<M/l<niN.  (86) 

mn  ^  ni  nj  — 

Similar  forms  to  (85)  hold  for  the  remaining  terms  in  (83). 

In  order  to  evaluate  (85),  2  exponentials  must  be 
computed.  Since  the  {F^}  sum  up  to  N,  this  means  a  total  of  2N 
exponentials  are  required  in  evaluating  the  complete  decision 
rule,  (83),  for  the  OPT-P,  when  the  differencing  scheme  in  (85) 
is  employed.  However,  to  determine  a  single  curve  on  a  receiver 
operating  characteristic,  both  a  false  alarm  probability  and  a 
detection  probability  must  be  simulated,  each  of  which  will 
require  the  evaluation  of  2N  exponentials . 

This  observation  regarding  the  false  alarm  probability  Pj  is 
worth  emphasizing.  Since  the  weights  {v^}  in  optimum  test  (83) 
depend  on  the  particular  signal  power  set  {^}  assumed  to  be  of 
interest,  according  to  (4),  it  is  necessary  to  rerun  P^  for  each 
different  curve  on  the  receiver  operating  characteristic  of  the 
OPT-P.  This  is  in  distinction  to  the  usual  case  (like  the 
power-law  processor)  where  a  single  common  P^  run  can  be  plotted 
against  several  different  P^  runs,  to  obtain  a  complete  set  of 
characteristics.  This  drawback  only  exists  for  the  (unrealistic) 
optimum  processor,  and  does  not  occur  for  practical  processors. 

There  is  a  numerical  facet  of  modified  form  (85)  that  must  be 
addressed  in  order  to  avoid  overflow  or  loss  of  significance 
during  the  calculations.  During  simulation  of  a  detection 
probability  P^,  the  two  bins  that  contain  signal  lead  to  larger 
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values  of  the  corresponding  observations  and  to  very  large 
values  of  the  corresponding  exponentials.  This  leads  to 
differences  of  large  quantities  in  (85)  on  occasion,  an  effect 
that  was  not  present  in  original  form  (83),  which  contained  only 
sums  of  positive  quantities. 

In  order  to  preserve  the  advantageous  numerical  shortcut  of 
(85),  the  four  large  terms  in  (85)  must  be  treated  specially. 

For  example,  during  simulation,  suppose  we  locate  the  two  signals 
in  band  in  bins  1  and  2,  without  loss  of  generality.  Then, 
the  four  exponentials  e^l'  ®12'  ®M1'  ®M2  become  very  large  on 
occasion.  Therefore,  we  separately  conduct  the  three  sums 


^1  "  ®13  "^  ***  “^  ®lFj  ' 
*^1  “  ®13  ®M3 
Then,  the  output  from  band 

(®11  ®12  *^l]  (^1  ^2  '*■ 

"  ®ll(®M2  ^l)  (®12  ^1 


®1  ®M3 


+  e. 


MFj  ' 


®lFj^  ®MFj^  * 


in  (85)  can  be  expressed  as 


l)  ,®11  ®M1  ®12  ^2  ^1 


®M1  ®1 


^1  ®M2  "  ^1  * 


(87) 


(88) 


Although  there  is  still  one  difference  left,  that  teirm,  t^,  does 
not  involve  any  of  the  large  exponentials,  thereby  avoiding 
cancellation  and  loss  of  significance.  The  damaging  very  large 
negative  terms,  namely  arid  ^-^2  ®m2'  been  completely 

eliminated  from  the  final  computation.  Relations  identical  to 
(88)  can  be  derived  for  the  remaining  bands  for  all  l<m<M, 

and  have  been  employed  in  the  simulation  of  OPT-P  test  (83). 
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If  pairing  were  insufficient  to  realize  a  tight  enough  bound 
on  performance,  the  procedure  could  be  extended  to  tripling, 
where  three  nonoverlapping  signals  are  grouped  in  one  band.  This 
constitutes  still  more  confusion  for  the  optimum  processor. 
However,  it  also  leads  to  additional  computational  burden.  For 
example,  the  useful  simplification  of  the  double  sum  in  (84) 
would  then  have  to  be  replaced  by  the  triple  sum  equivalent 


j  j  j  j  j 


(89) 


However,  there  will  now  be  nine  large  exponentials  that  would 
need  special  handling  in  order  to  avoid  loss  of  significance,  due 
to  the  presence  of  the  minus  signs  in  shortcut  (89).  This 
tripling  procedure  has  not  been  found  necessary  to  use  in  this 
current  study,  at  least  for  the  particular  parameter  values 
considered  here. 

In  the  special  case  where  M  =  N,  OPT-P  test  (83)  reduces  to 

^‘k)  ^k  ^‘n] }  < 

where  k  =  N  +  1  -  n.  This  sum  of  positive  terms  requires  the 
evaluation  of  only  N  exponentials . 

In  the  further  special  case  where  all  the  signal  powers 
are  equal,  then  the  weights  are  equal  and  (90)  can  be  further 
reduced  to  the  standard  result  for  the  energy  detector,  namely, 
comparison  of  linear  sum  x^^  +  X2  +  *  •  •  +  with  a  threshold. 
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EFFECTIVE  NUMBER  OF  OCCUPIED  BINS  AND  EFFECTIVE  SIGNAL  POWER 


When  the  M  signal  powers  are  unequal,  it  would  be 

very  tedious  to  have  to  determine  a  new  receiver  operating 
characteristic  for  each  particular  set  of  values  for  {^}*  In 
this  section,  we  detennine  an  effective  number  of  occupied  bins 
Mg  and  an  effective  signal  power  S^  that  can  replace  a  given 
(unequal)  set  of  powers,  for  1  i  m  i  M,  in  order  that  the 

previous  results  in  [4]  can  be  used,  at  least  approximately. 

First,  we  define  the  two  sums 


M 


C,  ‘EZ 


m=l 


M 


Co  -  n 


m=l 


S2 

-m 


(91) 


Without  loss  of  generality,  we  order  the  M  signal  powers  {^}  in 
descending  order.  Then,  we  replace  the  actual  power  distribution 
{^}  by  a  boxcar  of  height  Sg  and  extent  Mg,  such  that  the  sum  of 
the  signal  powers  and  the  sum  of  the  squared  signal  powers  are 
both  preserved.  That  is,  we  require  that  C,  =  S  M  and 

JL  w  w 

2 

C2  =  Sg  Mg.  The  solutions  to  these  equations  are  the  effective 
values 


^2 

S  =  77-  ,  for  which  S  M 
e  C,  e  e 


M 


C,  =  I _ _  S 

m=l 


(92) 


This  selection  of  effective  values  involves  all  the  individual 
signal  powers  for  1  <  m  <  M.  Furthermore,  the  calculation 

is  straightforward,  not  requiring  the  solution  of  any 
transcendental  equations . 
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If  all  the  signal  powers  {^}  are  equal  to  S  for  1  <  m  <  M, 

then  (92)  reduces  to  =  M  and  =  S,  as  expected.  On  the 

other  hand,  if  only  one  signal  power  is  nonzero,  then  (92)  yields 

M  =1  and  S  equal  to  that  power  value  ,  again  as  expected. 

0  0  ^ 

It  should  be  noted  that  this  approach  does  not  include  any 

dependence  on  the  specific  power-law  v  of  the  nonlinearity  x'*; 

however,  it  can  be  verified  that  this  choice  of  effective  values 

in  (92)  is  equivalent  to  matching  the  first  two  moments  of 

decision  variable  z  in  power-law  processor  (44)  for  the 

particular  power  v  =  1;  see  appendix  A. 

Since  the  effective  number  yielded  by  (92)  will  not 

generally  be  an  integer,  we  then  round  to  the  nearest  integer, 

simultaneously  varying  so  as  to  keep  the  product  fixed  at  the 

value  Cj^,  as  in  (92).  For  example,  consider  M  =  4,  four  occupied 

bins,  and  {^(dB)}  =  {10,  9,  8,  7}.  Then,  we  find  =  3.756, 

S  =  7.792  =8.92  dB,  and  C,  =  29.26.  We  round  these  values  to 
e  1 

M  =  4  and  S  =  7.316  =8.64  dB.  We  would  now  be  prepared  to 
0  ® 

enter  the  earlier  receiver  operating  characteristics  for  the 
corresponding  power-law  processor  in  [4],  using  these  latter 
rounded  values  for  and  in  place  of  M  and  S. 

The  number  of  search  bins  N  is  not  altered  by  any  of  these 
replacements,  and  need  not  be  changed  in  utilizing  the  earlier 
plots  in  [4].  Rather,  the  values  of  M  and  S  to  be  employed  with 
the  previously  plotted  receiver  operating  characteristics  are 
those  given  here  by  and  in  (92),  or  their  rounded  versions. 
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RECEIVER  OPERATING  CHARACTERISTICS  FOR  EQUAL  SIGNAL  POWERS 

In  this  section,  we  will  present  several  receiver  operating 
characteristics  (ROCs)  for  the  case  of  equal  signal  powers;  that 
is,  ^  for  1  <  m  <  M.  The  corresponding  ROCs  for  unequal 

signal  powers  {^}  are  collected  together  in  appendix  B. 

Due  to  the  unlimited  number  of  possibilities  for  unequal 
signal  powers,  we  have  confined  consideration  to  power  sets  for 
which  the  m-th  signal  power  (in  decibels)  follows  a  linear  law; 

^(dB)  =  Sj^(dB)  -  (m-1)  A(dB)  for  1  <  m  <  M  .  (93) 

Thus,  the  strongest  signal  power  in  the  set  occurs  for  m  =  1, 
without  loss  of  generality.  The  decrement  is  A(dB)  from  signal 
to  signal,  with  a  total  power  variation  across  the  set  of 
(M  -  1)A  dB.  All  the  results  in  this  section  are  for  A  =  0  dB, 
that  is,  equal  signal  powers.  Results  for  total  signal  power 
variations  (M  -  1)A  of  3  dB,  6  dB,  and  9  dB  are  given  in  the  next 
section  and  appendix  B. 

The  first  example  in  figure  1  is  for  v  =  “>,  the  maximum 
processor,  with  M  =  2  and  N  =  1024.  (All  the  equal-signal-power 
figures  are  collected  together  at  the  end  of  this  section. )  The 
solid  curves  apply  to  the  power-law  processor  (PLP),  and  are 
indexed  by  the  largest  signal  power  in  decibels,  Sj^(dB).  The 
false  alarm  and  detection  probabilities,  and  P^,  were 
determined  directly  from  analytic  results  (55),  (56),  and  (4). 
Superposed  as  a  dashed  line  is  the  ROC  for  the  optimum  banded 
processor  with  pairing,  OPT-P,  based  upon  a  simulation  employing 
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10  million  independent  trials  for  both  and  P^.  The  pair  of 
arrows  point  to  the  two  curves  with  identical  power  level  sets 
{^}  for  the  PLP  and  for  the  corresponding  OPT-P.  The  closeness 
of  these  two  particular  curves  indicates  that  if  the  PLP  (which 
is  totally  ignorant  of  M  and  {^})  were  allowed  to  operate  with  a 
signal  level  that  is  less  than  0.1  dB  stronger,  it  would  be  able 
to  achieve  the  same  performance  level  as  the  optimum  processor, 
which  knows  and  uses  all  these  parameter  values. 

The  deviation  between  the  OPT-P  simulation  and  the  PLP 
analytic  calculation,  near  false  alarm  probabilities  P^  =  lE-6, 
is  probably  due  to  the  rather  limited  number  of  trials  used  for 
that  region,  namely  1E7  trials.  Thus,  this  region  of  the 
simulated  ROC  (dashed  curve)  is  not  too  trustworthy. 

The  apparent  smoothness  of  the  simulated  ROC  in  figure  1  can 
be  somewhat  misleading.  Since  the  single  set  of  1E7  P^  trial 
results  is  used  to  estimate  the  exceedance  distribution  function 
for  all  threshold  values,  there  is  considerable  correlation 
between  the  probability  estimates;  see  appendix  C.  For  two 
thresholds  located  fairly  close  together,  this  high  degree  of 
correlation  means  that  the  two  probability  estimates  will 
fluctuate  together,  with  both  tending  to  be  high  or  both  tending 
to  be  low  for  a  particular  run  of  data.  This  will  tend  to  make  a 
plot  of  the  sample  exceedance  distribution  function  versus 
threshold  look  smoother  than  it  really  should.  Coupled  with  the 
same  behavior  for  the  P^  simulation,  this  effect  will  lead  to 
sample  ROCs  with  a  smoother  appearance  than  justified,  and  can  be 
misleading  regarding  stability. 
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The  only  change  in  figure  2  is  to  increase  M  from  2  to  4. 

The  slightly  larger  discrepancy  between  the  two  corresponding 
curves  (see  arrows),  namely,  ~0.2  dB,  is  consistent  with  the 
observation  [1]  that  the  maximum  processor,  v  =  “,  is  more  nearly 
optimum  for  very  small  M.  This  trend  is  continued  in  figures  3 
and  4,  where  M  =  8  and  16,  respectively.  When  the  number  of 
occupied  bins  reaches  M  =  16,  the  maximum  processor  is  about  1  dB 
poorer  than  the  OPT-P  in  the  neighborhood  of  our  standard 
operating  point,  namely,  P^  =  0,001  and  P^  =  0,5.  This  is  a  loss 
that  we  do  not  have  to  accept,  if  we  will  simply  change  the  power 
law  V.  We  have  not  investigated  larger  values  of  M  than  16  here 
for  V  =  «,  because  the  losses  increase  dramatically,  and  a 
different  PLP  should  be  used,  instead. 

Receiver  operating  characteristics  for  the  PLP  v  =  3  are 
presented  in  figures  5-11  for  M  =  2,  4,  8,  16,  32,  64,  128, 
respectively.  Here,  the  detection  probability  P^  for  the  PLP  was 
evaluated  by  simulation,  with  the  number  of  trials  as  indicated 
on  each  figure.  The  false  alarm  probability  P^  was  found 
analytically  by  means  of  (46)  and  (64).  Thus,  the  ROCs  for  the 
PLP  are  rather  accurately  located.  Comparisons  at  the  standard 
operating  point  with  the  best  ROC  (dashed  curve)  for  the  OPT-P, 
reveal  that  the  minimiim  loss  with  PLP  v  =  3  occurs  around  M  =  16 
or  M  =  32,  namely,  on  the  order  of  0.1  dB.  By  the  time  M  =  128 
is  reached  in  figure  11,  the  loss  near  P^  =  lE-6  is  well  over 
1  dB.  Therefore,  as  above,  still  larger  values  of  M  were  not 
investigated  here,  at  least  for  v  =  3. 
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Receiver  operating  characteristics  for  PLP  v  =  2.5  are  given 
in  figures  12  -  18  for  M  =  8,  16,  32,  64,  128,  256,  512,  respect¬ 
ively.  Now,  the  minimum  loss  occurs  near  M  =  64;  see  figure  15, 
where  the  PLP  performs  near  optimality.  The  minimum  loss  is  less 
than  0.1  dB  at  the  standard  operating  point,  but  becomes  greater 
than  1  dB  for  larger  M,  such  as  M  =  512  in  figure  18. 

Receiver  operating  characteristics  for  the  square-law  PLP 
■\)  =  2  are  given  in  figures  19  -  24  for  M  =  32,  64,  128,  256,  512, 
1024,  respectively.  In  this  case,  the  minimum  loss  occurs  near 
M  =  128;  see  figure  21,  where  the  curves  for  the  PLP  and  the 
OPT-P  virtually  overlap  over  the  complete  range  of  P^  plotted. 

For  the  larger  value  of  M  =  1024  in  figure  24,  the  loss  increases 
to  about  0.6  dB  at  the  standard  operating  point. 

Finally,  the  ROCs  for  the  standard  "energy  detector"  v  =  1 
are  presented  in  figures  25  -  28  for  M  =  128,  256,  512,  1024, 
respectively.  Lower  values  of  M  (less  than  128)  were  not 
considered  here  for  v  =  1,  due  to  their  larger  losses.  As 
expected,  the  minimum  loss  of  0  dB  is  realized  in  figure  28  for 
M  =  N  =  1024,  where  the  two  ROCs  for  the  analytical  PLP  and  the 
simulated  OPT-P  are  virtual  overlays. 

From  these  plots,  the  signal  powers  required  to  realize  the 
standard  operating  point  can  be  extracted  for  the  various  PLPs 
employing  different  values  of  power  law  v.  Furthermore,  the  same 
information  for  a  higher  quality  operating  point,  such  as 
=  ie-6  and  P^  =  0.9,  is  also  available  from  these  plots. 

These  results  indicate  what  signal  levels  will  be  required  in 
practice  to  reliably  detect  random  signals  in  this  environment. 
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Probability  of  False  Alarm 


Figure  1.  ROCs  for  v='»,  M  =  2,  N  =  1024,  A  =  0  dB 
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Probability  of  False  Alarm 
Figure  2.  ROCs  for  v=®,  M=4,  N=  1024,  A  =  0  dB 
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Figure  3,  ROCs  for  v  =»#  M=8,  N=  1024,  A  =  0  dB 
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Figure  4.  ROCs  for  v="/M=16,  N=  1024,  A  =  0  dB 
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Figure  6.  ROCs  for  v=3,  M=4,  N=  1024,  A  = 
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Figure  7.  ROCs  for  v  =  3,  M  =  8,  N  =  1024,  A  =  0  dB 
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Probability  of  False  RIarm 

Figure  8.  ROCs  for  v=3,  M=16/N=  1024,  A  =  0  dB 
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Figure  9.  ROCs  for  v=3,  M=32/N=  1024,  A  =  0  dB 
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Figure  10.  ROCs  for  v=3,  M=64,  N=  1024,  A  =  0  dB 
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Figure  11.  ROCs  for  v  =  3,  M  =  128,  N  =  1024,  A  =  0  dB 
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Figure  12.  ROCs  for  v=2.5,  M=8,  N=  1024,  A  =  0  dB 
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Figure  13.  ROCs  for  v  =2.5,  M  =  16,  N  =  1024,  A  =  0  dB 
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Probability  of  False  Alarm 

Figure  15.  ROCs  for  v  =  2.5,  M  =  64,  N  =  1024,  A  =  0  dB 
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Probability  of  False  Rlarm 

Figure  16.  ROCs  for  v  =  2.5,  M  =  128,  N  =  1024,  A  =  0  dB 
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Probability  of  False  Rlarm 

Figure  17.  ROCs  for  v  =2.5,  M=  256,  N  =  1024,  A  =  0  dB 
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Figure  18.  ROCs  for  v  =  2.5,  M  =  512,  N  =  1024,  A  =  0  dB 
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Figure  19.  ROCs  for  v=2/M=32,  N=  1024,  A  =  0  dB 
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Probability  of  False  Alarm 


Figure  20.  ROCs  for  v=2,  M=64/N-  1024,  A  -  0  dB 
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Probability  of  False  Rlarm 


Figure  21.  ROCs  for  v  =  2,  M  =  128,  N  =  1024,  A  =  0  dB 
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Figure  22.  ROCs  for  v  =2,  M  =  256,  N  =  1024,  A  -  0  dB 
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Figure  23.  ROCs  for  v  =  2,  M  =  512,  N  =  1024,  A  =  0  dB 
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Figure  24.  ROCs  for  v  =2,  M  =  1024,  N  =  1024,  A  =  0  dB 
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Figure  25.  ROCs  for  v  =  1,  M  =  128,  N  =  1024,  A  =  0  dB 
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Figure  26.  ROCs  for  v  =  M  =  256,  N  =  1024,  A  =  0  dB 
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Figure  27.  ROCs  for  v  =  1,  M  =  512,  N  =  1024,  A  =  0  dB 
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Figure  28.  ROCs  for  v  =1,  M  =  1024,  N  =  1024,  A  =  0  dB 
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PERFORMANCE  OF  POWER-LAW  PROCESSORS  FOR  UNEQUAL  SIGNAL  POWERS 

As  stated  previously,  a  number  of  receiver  operating 
characteristics  for  unequal  signal  powers  have  been  run  for  the 
PLP  and  the  OPT-P;  they  are  collected  in  appendix  B.  They 
correspond  to  the  28  figures  given  above  for  equal  signal  powers. 
In  particular,  a  complete  set  of  28  ROCs  has  been  run  for  each  of 
the  three  cases  (for  a  total  of  84  figures),  where  the  signal 
power  variation  (maximum  relative  to  minimum)  is  approximately 
3  dB,  6  dB,  and  9  dB,  respectively,  across  the  total  signal  set; 
see  the  discussion  surrounding  (93)  for  additional  details,  such 
as  the  linear  variation  with  signal  number,  m. 

The  first  ROC  in  appendix  B,  figure  B-1,  corresponds  to  the 
maximum  processor,  v  =  <»,  with  M  =  2,  N  =  1024,  and  the  signal 
decrement  A  =  3  dB.  That  is,  the  difference  in  decibels  between 
adjacent  signal  strengths  in  the  set  of  size  M  is  A  dB;  see  (93). 
The  superposed  dashed  curve  in  figure  B-1  is  the  ROC  for  the 
OPT-P,  which  knows  and  uses  the  knowledge  of  M  and  of  all  the 
unequal  signal  powers  The  label  Sj^(dB)  on  each  curve 

corresponds  to  the  maximum  signal  power  (in  decibels)  in  the 
signal  set  of  size  M.  A  similar  procedure  and  notation  has  been 
adopted  for  all  the  remaining  figures  in  appendix  B. 
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LOSS  BEHAVIOR  OF  POWER-LAW  PROCESSORS 

From  the  totality  of  ROCs  in  the  previous  section  and  in 
appendix  B/  it  is  possible  to  make  a  direct  quantitative 
comparison  of  various  PLPs  (that  is,  different  v)  with  the  OPT-P. 
In  particular,  the  additional  signal  power  level  required  for  the 
PLP,  in  order  to  match  the  OPT-P  detection  performance  at  the 
standard  operating  point,  can  be  extracted.  This  is  called  a 
loss  here,  in  that  it  is  the  amount  by  which  the  PLP  falls  short 

of  optimality. 

Results  for  this  loss  (in  decibels)  for  the  standard  energy 
detector,  that  is,  PLP  v  =  1,  are  plotted  in  figure  29  for  search 
size  N  =  1024  and  for  the  required  detectability  level  at  the 
standard  operating  point,  namely,  P^  =  0.001,  P^  =0.5.  It  is 
very  important  to  notice  that  the  abscissa  in  figure  29  is 
effective  number  defined  in  (91)  and  (92) ,  not  simply  M,  the 
number  of  bins  occupied  by  signal. 

The  reason  for  this  choice  is  twofold.  First,  the  fit  of  the 
loss  curve  to  a  quadratic  is  much  better  versus  than  it  is 
versus  M.  Second,  for  a  signal  set  with  significantly  different 
signal  powers  the  quantity  M  is  not  a  good  measure  of  the 

number  of  "occupied"  bins.  For  example,  a  set  of  M  =  10  signals, 
half  of  which  have  power  level  0  dB  and  half  of  which  have  power 
level  -20  dB,  is  obviously  better  characterized  as  a  set  of  five 
signals,  because  the  remaining  five  weak  signals  have  very  little 
beneficial  effect  on  detectability.  The  effective  number 
takes  this  variation  of  all  the  signal  power  levels  into  account. 
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The  points  plotted  in  figure  29  should  be  considered  in 
groups  of  four.  For  example,  the  four  points  labeled  A,  B,  C,  D 
were  all  computed  for  M  =  128  (see  point  A),  and  correspond, 
respectively,  to  a  total  power  variation  of  (M-  1)A=0,  3,  6,  9 
dB,  approximately.  Thus,  by  the  time  the  9  dB  total  variation  is 
reached,  M  has  decreased  from  128  to  83.8.  The  decrease  in  M 
is  monotonic  as  the  signal  power  decrement  A(dB)  increases. 

The  selection  of  a  quadratic  fit  to  the  loss  numbers  in 
figure  29  is  intuitive,  and  is  not  made  on  any  particular 
analytical  basis.  However,  the  closeness  of  the  fit  justifies 
its  use,  at  least  in  the  range  here,  where  the  losses  are  less 
than  1  dB.  It  will  be  noticed  that  the  loss  of  the  energy 
detector  goes  to  zero  as  the  effective  number  of  occupied  bins 
tends  to  N  =  1024.  This  is  in  keeping  with  the  well-known 
optimality  of  the  energy  detector  for  broadband  signals. 

Additional  loss  results  for  the  PLPs  v  =  2,  2.5,  3,  ®  are 
given  in  figures  30,  31,  32,  33,  respectively.  Again,  quadratic 
fits  to  the  loss  numbers  have  been  utilized  and  do  adequate  jobs 
in  all  cases.  In  fact,  there  are  several  reasons  why  the 
quadratic  fits  are  not  even  better.  One  is  an  inability  to  read 
the  losses  any  more  accurately  from  the  ROCs  given  earlier. 

Also,  although  P^  was  kept  constant  at  0.001  in  all  of  the 
extraction  procedure,  it  was  not  possible  to  maintain  P^  exactly 
at  the  same  value  of  0.5;  rather,  due  to  a  practical  limit  on  the 
number  of  ROCs  that  could  be  plotted,  the  closest  representative 
value  of  P^  in  the  neighborhood  was  used.  Finally,  abscissa 
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is  still  an  ad  hoc  measure  of  the  effective  number  of  occupied 
bins,  although  it  is  considerably  better  than  direct  use  of  M. 

The  progression  of  the  minimum  loss  location  in  figures 

29  -  33  is  from  M  =  1024  down  towards  M  =  1,  as  power-law  v 

0  “ 

increases  from  1  to  This  is  in  keeping  with  earlier  results, 

which  were  limited  to  equal  signal  powers  [1].  Furthermore,  the 
minimum  loss  stays  below  the  0.1  dB  range,  regardless  of  the 
actual  signal  powers  or  the  set  size  M.  In  fact,  if  we  look 

at  any  one  of  the  loss  curves  in  figures  29  -  33,  we  observe  that 
each  complete  set  of  losses  follows  the  same  quadratic  curve 
versus  M^,  regardless  of  the  variation  in  signal  power  levels 
{S  }.  That  is,  all  four  cases  (A,  B,  C,  D)  are  well  fitted  by 
the  same  quadratic,  despite  the  fact  that  a  9  dB  variation  is 
present  in  case  D. 

Therefore,  it  is  expected  that  the  relative  performance  of  a 
PLP  with  given  v  can  be  found  (approximately)  directly  from 
figures  29  -  33,  once  the  signal  set  {^}  is  prescribed,  without 
having  to  generate  the  entire  set  of  ROCs.  These  figures  also 
verify  that  the  PLP  can  be  confidently  used  for  near-optimum 
detection  of  signal  sets  with  widely  different  power  levels;  this 
attribute  was  previously  known  only  to  hold  for  equal  signal 
power  levels  [1].  The  particular  case  of  v  =  2.5  in  figure  31 
again  constitutes  a  minimax  solution,  in  that,  regardless  of 
signal  size  M  and  strengths  {^1/  the  loss  of  this  PLP  relative 
to  OPT-P  is  never  greater  than  1.2  dB;  actually,  v  =  2.4  is  the 
best  choice.  This  remarkable  result  for  this  particular  PLP 
makes  it  a  very  robust  detector  indeed. 
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PERFORMANCE  FOR  A  STEPPED  SIGNAL  POWER  DISTRIBUTION 


All  the  previous  results  have  been  for  a  signal  power 
variation  (in  decibels),  which  varies  linearly  with  signal  number 
m;  see  (93).  In  order  to  ascertain  if  this  uniform  spread  of 
signal  powers  is  coloring  the  results,  a  distinctly  different 
variation  of  signal  powers  is  considered  in  this  subsection. 

A  signal  set  of  size  M  =  64  is  considered,  where 


0.5  , 


^41 


0.25  . 


(94) 


Thus,  the  signal  powers  are  limited  to  just  four  different 
levels,  with  a  different  number  of  signals  within  each  step.  The 
ROC  for  PLP  V  =  2.5  is  presented  in  figure  34  for  N  =  1024.  The 
curves  for  this  case  are  labeled  differently  than  for  all  the 
previous  cases.  The  central  curve  labeled  0  corresponds  to  the 
particular  set  of  power  values  {^}  given  in  (94).  The  curve 
labeled  +1,  on  the  other  hand,  corresponds  to  all  the  signal 
powers  {^1  having  been  increased  by  1  dB;  similarly,  the  curve 
labeled  -1  has  had  all  its  signal  powers  lowered  by  1  dB  relative 
to  ( 94 ) .  The  superposed  dashed  curve  still  refers  to  the  OPT-P 
processor  for  signal  power  set  (94). 

The  loss  of  the  v  =  2.5  PLP  near  the  standard  operating  point 
(0.001,  0.5)  is  approximately  0.08  dB,  as  seen  from  figure  34. 
This  value  agrees  with  that  read  off  the  loss  plot  in  figure  31 
for  V  =  2.5  near  =  41.6;  this  latter  quantity  is  the  effective 
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number  of  signals  for  signal  power  set  (94).  In  fact,  figure  34 
bears  a  very  close  resemblance  to  the  ROC  in  figure  B-45  for  the 
example  with  v  =  2.5,  M  =  64,  and  =  46.5;  also,  the  total 
power  of  the  central  curve  in  figure  B-45  (labeled  Sj^(dB)  =  4 )  is 
65.9,  which  is  very  close  to  the  total  power  for  the  central 
curve  in  figure  34  (labeled  0),  namely,  64.  Thus,  the  earlier 
loss  curves  apply  to  this  very  different  signal  power 
distribution  also. 

In  order  to  see  how  closely  the  concept  of  the  effective 
number  of  signals  describes  detectability  for  a  particular  set 
of  unequal  signal  powers,  the  "equivalent"  ROC  for  the  v  =2.5 
PLP  using  effective  values  is  superposed  in  figure  35  as  the 
dashed  curves .  For  the  central  curve  ( labeled  0 ) ,  the  equivalent 
ROC  crosses  the  true  ROC.  As  the  signal  powers  are  increased, 
the  equivalent  ROC  becomes  progressively  more  optimistic, 
typically  overestimating  the  performance  levels;  for  lower  signal 
levels,  the  equivalent  ROC  is  pessimistic.  Whether  the 
discrepancies  between  ROCs  are  acceptable  in  a  specific 
application  depends  upon  the  particular  operating  point  of 
interest.  It  appears  that  for  detection  probabilities  P^  in  the 
neighborhood  of  0.5,  the  discrepancy  is  negligible  over  a  wide 
range  of  false  alarm  probabilities  P^;  however,  a  wide  range  of 
comparison  examples  would  need  to  be  run  in  order  to  verify  this 
observation  more  generally. 
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Figure  33.  Loss  of  PLP  v  =  <»  Relative  to  OPT-P 
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Figure  34.  ROCs  for  v=2.5,  M=64,  N=  1024,  stepped  powers 
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Figure  35.  Equivalent  ROCs  for  the  PLP 
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CONCLUSIONS 

The  optimum  processor  for  detection  of  random  signals  with  no 
structure  has  been  derived  and  then  approximated  in  order  to 
arrive  at  a  practical  class  of  processors.  The  resultant  class 
of  power-law  processors,  PLPs,  has  been  thoroughly  investigated 
quantitatively  in  terms  of  its  false  alarm  and  detection 
probabilities,  resulting  in  numerous  receiver  operating 
characteristics  for  various  values  of  the  power-law  v. 

An  upper  bound  on  detectability  for  any  processor  operating 
in  this  environment  has  been  ascertained  by  means  of  an  optimum 
banded  processor  with  pairing,  OPT-P.  This  unrealistic 
mathematical  artifice  can  be  readily  simulated,  and  furnishes  a 
very  tight  upper  bound  on  attainable  performance.  In  fact,  no 
practical  processor  can  ever  outperform  the  OPT-P;  it  furnishes 
the  bottom  line  on  attainable  performance  in  this  structureless 
environment . 

Comparison  of  the  PLP  class  with  the  OPT-P  indicates  that 
there  always  exists  a  PLP  that  performs  within  0.1  dB  of  the 
signal  power  level  of  the  optimum  processor.  However,  selection 
of  the  best  power-law  value  v  would  require  knowledge  of  the 
effective  niimber  of  signals,  M^,  being  detected.  Since  this 
knowledge  will  not  be  available  in  practice,  the  best  minimax 
solution  is  to  use  power-law  v  =  2.4,  in  which  case  the  loss  of 
the  PLP  relative  to  the  OPT-P  is  never  greater  than  1.2  dB, 
regardless  of  the  signal  set  size  M  and  the  signal  power 
distribution  {^}. 
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Loss  curves  for  the  PLP  class  have  been  determined  for  the 
five  cases  of\)  =  l,  2,  2.5,  3,  In  order  to  apply  these 

results  to  a  given  signal  power  distribution  {^}/  the  effective 
number  of  signals,  M^,  must  be  computed  according  to  (91)  and 
(92).  This  simple  calculation  indicates  what  value  of  v  should 
be  used  for  minimum  loss,  and  what  additional  loss  will  be 
incurred  through  the  use  of  mismatched  values  of  v. 

The  additive  noise  power  level  has  been  presumed  known 
throughout  this  study;  in  fact,  it  was  normalized  at  unit  level, 
so  that  the  quantity  ^  is  also  the  signal-to-noise  ratio  in  a 
single  bin.  An  extension  to  unknown  noise  levels  and  the 
normalization  that  must  accompany  the  processor  are  underway. 
Also,  the  effects  of  nonwhite  noise  on  the  performance  of  the  PLP 
are  currently  under  investigation. 
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APPENDIX  A  -  EFFECTIVE  NUMBER  OF  SIGNALS 
FOR  THE  POWER-LAW  PROCESSOR 


When  the  M  occupied  signal  bins  all  have  common  average 
signal  powers  S,  the  effective  nximber  of  signals,  is 

obviously  given  by  =  M.  However,  when  the  average  signal  bin 
powers  {^1  ^re  unequal,  a  definition  of  an  effective  number  of 
signals  is  more  difficult  to  determine.  We  address  this  problem 
here  for  the  case  of  the  v-th  power-law  processor. 

The  decision  variable  of  the  v-th  power-law  processor  is 


z 


N 


zz 

n=l 


(A-l) 


The  general  p-th  moment  of  bin  output  when  occupied  by  a 
signal  with  average  power  is 


x^  =  r(p+l)  (1  +  S  for  1  <  m  <  M  ,  (A-2) 

Itl  \  r-  f  \  -~in'  — 

where  we  utilized  the  exponential  density  of  random  variable  x^^^. 
This  leads  to  the  mean  of  output  z  in  (A-l)  in  the  form 


z 


r(v+i) 


- 

HZ  (1  +  +  N 

* - r*  '  —in 

(m=l 


M 


(A-3) 


and  a  variance  of  z  as 


-  1 

gI  =  [r(2v+i)  -  r^(v+i)] 

ZZ  (1  +  +  N  -  M 

1  > 

where  we  used  the  independent  identically  distributed  character 
of  the  set  of  random  variables  {x^^}  in  (A-l). 
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If  the  actual  signal  powers  {^}  were  all  replaced  by  a 
common  effective  signal  power  and  if  the  actual  number  M  of 
occupied  bins  were  replaced  by  an  effective  number  equations 
(A-3)  and  (A-4)  would  reduce,  respectively,  to 


z  ^  r(v+l)  Mg  (1  +  Sg)^  +  N  -  Mg 


(A-5) 


and 


[r(2v+i)  -  r^(v+i) 


Me  (1  +  Sg)2^  + 


N  -  M^ 
ej 


(A-6) 


We  now  equate  the  right-hand  sides  of  (A-3)  and  (A-5),  as  well  as 
equating  the  right-hand  sides  of  (A-4)  and  (A-6);  that  is,  in  the 
replacement  procedure,  we  maintain  the  same  first  two  moments  of 
random  variable  z. 

In  order  to  solve  for  the  effective  quantities  Sg  and  Mg,  we 
define  the  two  auxiliary  quantities 


for  k  =  1  and  2  . 


(A-7) 


Then,  for  equality  of  the  first  two  moments,  as  required  above, 
we  must  have 


M. 


[d  +  S^)''  -  l]  =  q] 


and 


M 


(1  +  Sg) 


2v 


-  1  = 


=  q2  •  (A-8) 


The  solutions  of  these  two  equations  are  immediately  given  by  the 
explicit  forms 


"e  = 


Qo  - 


1/v 


M  = 
e 


^1 


^2 


-  2 


^1 


(A-9) 
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Specification  of  a  particular  signal  power  set  {^}  and  M  leads 
directly  to  the  effective  quantities  through  the  use  of  (A-7)  and 
(A-9),  without  the  need  for  any  transcendental  equation 
solutions . 

In  the  special  case  of  ^  =  S  for  1  <  m  <  M,  then  for 
arbitrary  v,  we  have 


q^  =  M  [(1  +  S)^  -  l]  ,  ^2  “  ^  ^ 


q2  -  M  [{1  +  S)^  -  l]  , 

2 

q2  -  2  q^  =  M  [(1  +  S)'’  -  ij  , 


(A-10) 


leading  to  solutions  =  S,  =  M,  as  expected  and  required, 
regardless  of  v. 

In  the  alternative  special  case  of  v  =  1,  we  have  instead 


^1 


M 


m=l 


^2 


M 


(A-11) 


which  leads  directly  to  the  familiar  forms 


M 


c  -  ro=l 
^e  M 


S2 

-m 


Me  = 


M 


m=l 


-ion 


M 


(A-12) 


m=l 


— m 


m=l 


— m 


Notice  that  S  M  *  2  S„,  which  is  the  total  signal  power,  but 
e  6  m  —in 

only  for  this  special  case  of  v  =  1.  Results  for  other  values  of 
V  are  much  more  complicated,  and  can  only  be  found  numerically. 


97 


TR  11123 


A  numerical  example  for  four  occupied  signal  bins,  M  =  4, 


with  average  signal  powers  ^  =  10,  9,  8,  7,  leads  to  the 
following  results  as  a  function  of  the  power  law  v; 


V 

0+ 

.5 

1.0 

1.5 
2.0 

2.5 
3.0 

10.0 

45 


8.50 

8.57 

8.65 

8.73 

8.82 

8.91 

8.99 

9.69 

10- 

10 


4.00 

3.97 

3.93 

3.87 

3.79 

3.69 

3.58 

2.09 

1.03 

1 


see  that  the  effective  signal  power  varies  from  the  average 
of  the  set  of  powers  to  the  maximum  of  that  set,  as  v  varies 

from  0  to  «>.  At  the  same  time,  the  effective  number  varies 
from  M  down  to  1.  On  the  other  hand,  for  v  limited  to  the  range 
1  to  3,  which  is  our  typical  range  of  application  and  importance, 
the  effective  quantities  are  relatively  constant  and  fairly  well 
approximated  by  the  simple  results  for  v  =  1,  as  given  by  (A— 12). 
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APPENDIX  B  -  RECEIVER  OPERATING  CHARACTERISTICS 
FOR  UNEQUAL  SIGNAL  POWERS 

In  figures  1  -  28  of  the  main  text,  numerous  receiver 
operating  characteristics  (ROCs)  were  presented  for  the  case  of 
equal  average  signal  powers  in  all  the  bins  occupied  by  signals. 
In  this  appendix,  we  complement  those  results  with  numerous  cases 
of  unequal  signal  powers,  namely  figures  B-1  through  B-84 .  In 
particular,  as  noted  already  in  (93),  the  m-th  signal  power 
(in  decibels)  follows  the  linear  law: 

^(dB)  =  S^(dB)  -  (m-1)  A(dB)  for  1  <  m  <  M  .  (95) 

Thus,  is  the  largest  signal  power  in  the  set  and  A(dB) 

is  the  decrement  in  adjacent  signal  power  levels. 

An  explanation  of  figure  B-1  is  as  follows.  The  solid  curves 
are  for  the  maximum  PLP  v  =  “,  with  M  =  2,  N  =  1024.  The 
decrement  A(dB)  is  indicated  on  the  figure  as  being  3  dB  for  this 
example,  while  the  individual  curves  are  labeled  according  to  the 
largest  signal  power  in  each  set.  Thus,  the  curve  labeled  12 
has  =  12  dB  and  S2  =  9  dB.  These  receiver  operating 
characteristics  were  determined  analytically.  (When  P^  was  found 
by  simulation,  the  number  of  independent  trials  is  indicated  on 
the  figure.) 

The  superposed  dashed  curve,  coupled  by  arrows  to  the  curve 
labeled  12,  is  for  the  OPT-P,  which  knows  and  uses  the 
information  M  =  2,  Sj^  =  12  dB,  and  S2  =  9  dB  in  an  optimum 
fashion  to  maximize  the  detection  probability  P^  for  a  given 
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false  alarm  probability  P^.  This  receiver  operating 
characteristic  for  the  OPT-P  was  found  by  a  simulation  involving 
1E7  independent  trials. 

The  loss  of  the  PLP  relative  to  the  OPT-P  in  figure  B-1  is 
very  small  for  all  P^  values  indicated.  However,  by  the  time  M 
is  increased  to  16  in  figure  B-12,  the  loss  of  this  PLP  at  the 
standard  operating  point  has  increased  to  about  0.7  dB.  The 
example  in  this  figure  utilizes  A  =  0.6  dB,  which  means  that  the 
total  signal  power  variation  over  the  set  is  (M  -  1)  A(db)  = 

15  *  0.6  =  9  dB. 

The  receiver  operating  characteristics  are  grouped  in  the 
order  v  =  »,  3,  2.5,  2,  1.  Thus,  the  standard  energy  detector 
results,  V  =  1,  are  located  at  the  end  of  this  appendix.  The 
final  example  in  figure  B-84  utilizes  A  =  0.009  dB  and  M  =  1024, 
giving  a  total  variation  of  9.216  dB  in  signal  powers. 

In  all  cases,  the  total  search  size  is  N  =  1024.  The  number 
of  bins  occupied  by  signal  varies  from  M  =  2  through  M  =  N  =1024. 
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Figure  B-35.  ROCs  for  v»2»5,  M=8,  A»1  Figure  B-36.  ROCs  for  v=2.5,  M=8 


TR  11123 


uo.n.o3;.s(]  j.0  I 


uoi)03^3g  j.0  iqcqojcj 


119 


.99 


TR  11123 


1^ 


uot^033.8(j  J.0  X^.mqeqoj(j 


U0U38^3(I  }0  X^i  I 


120 


TR  11123 


j-0  XiK[iqEqoj(j 


121 


TR  11123 


uoiq,0949[[  j-0  I  I  1 


122 


TR  11123 


cn 

o 

II 

< 


00 

CN 


m 


cs 

11 

p 


V4 

o 

(H 


(0 

O 

o 


so 

I 

m 

o 

u 

o> 

•H 


uoi^03^3g  j.0  ^  I q^qojcj 


123 


TR  11123 


UDl^3318II  J-0  /^^.l  I  iqcqoJd 


o 

u 

<3 


E 

i. 

to 

E 

o 

CD 

10 

Li- 


o 

>N 


10 

JS 

o 

1. 

CL 


m 

cs 


h 


ID 

(N 

tt 

u 

o 

4-1 

(0 


a 

o 

cr: 


in 

I 

CQ 

0) 

W 

S3 

O' 

•H 


126 


TR  11123 


uoi^38q.9(j  j-0  X^i[iqcqoJcj 


cs 

o 

• 

II 

<3 


CS 

iH 

in 


SI 


tn 

• 

CS 

II 

;> 

u 

o 


CO 

a 

§ 


ro 

m 

I 

CQ 


0) 

U 

O 

CP 

•H 

1^ 


127 


TR  11123 


uou30^s(r  i^o 


128 


TR  11123 


uo(^08^ati  J.0  Xt),t  I  jqBqoJd 


m 

© 

tl 

<3 


a 

L. 

(0 

VO 

E 

SI 

(0 

M 

rts 

U. 

11 

? 

*«- 

0 

Ui 

X 

o 

•H 

VH 

Z 

in 

xi 

U 

(0 

O 

J3 

O 

o: 

&. 

CL 

• 

00 

in 

1 

1 

CQ 

<D 

U 

0 

O' 

•H 

▻4 

<n 

• 

11 

<3 

% 

E 

OJ 

c. 

CO 

to 

II 

E 

SI 

o 

«9 

CN 

10 

It 

b- 

P> 

«4- 

w 

o 

o 

vw 

4> 

CO 

■VM 

O 

J3 

o 

10 

JQ 

QC 

O 

IL 

• 

Q. 

in 

■ 

1 

PQ 

0) 

U 

0 

O' 

•H 


UOUOO^OQ  ^0  X^HjqeqoJcJ 


129 


TR  11123 


uoii.o3^3[[  J.0  [  iqEqoJd 


130 


TR  11123 


uouo»^»a  J-o  /<tn[}qeqoJd 


J-o  >^^HiqcqoJd 


131 


TR  11123 


132 


TR  11123 


E 

L, 

pa 

E 

o 

e 

0 

u. 


o 


JP 

10 

o 


uouoo1^9g  j.0  ^^niq«qoJd 


o 

K 

<3 


VO 
If) 
fNj  - 


SI 


fS 

II 

7> 

U 

o 

MH 


CO 

a 

o 

a: 


VO 

VO 

I 

CQ 

0) 

0 

O' 

•H 

1^4 


uouoa^aQ  J^o 


133 


TR  11123 


U0U33^3(I  J-0  X;.}[iqBq0Jd 


cs 

o 

• 

n 

< 


cs 
in  - 


SI 


CS 

ii 

u 

o 

M-l 


CO 

U 

o 


• 

00 

VP 

I 

ffl 

0) 

U 

0 

•H 


uoiq.03q.8Q  J.0  Aq.  I  [  .^  cjB 


134 


TR  11123 


135 


TR  11123 


(U 


8 

8 


8 


T 

U1 


*15 

u. 


o 

>s 


JD 

m 

M 

o 

a. 


uo\%OQ%Q[i 


a\ 

o 

o 

• 

II 

<3 


CN 

O 


CN 

II 

?> 

u 

o 

CO 


O 

§ 


CN 

I 

(U 

u 

•H 

Pm 


UO^^Od^dQ  J.0 


£ 

s. 

10 

E 

o 

*10 

u. 


>. 


JQ 

10 

JQ 

o 

c 


CL 


VO 

O 

o 

li 

<3 


CN 

o 


CN 

II 

P 

V4 

o 

tM 


CO 

O 


I 

0 

0) 

U 

0 

•H 

Pm 


136 


TR  11123 


uoii^-oa^aU  j.o  X^^iqBqoJd 


VO 

o 

» 

<J 


00 

cs 


II 

? 

u 

o 

VM 

CO 


a 

o 

Qi 


XT 

I 

CQ 

O 

U 

0 

O' 

•H 

U4 


uoit^09t|.3[i  J.0  X^miq^qojd 


137 


TR  11123 


CN 

o 

II 

<3 


VO 

in 

f>a 


Si 


II 

Ui 

o 

M-1 

m 


O 

§ 


VO 

I 

ffl 

O 

U 

a 

cn 

•H 


U0l^D9^9(I  J.0  X^l  [ 


uoiq.o3^3[I  J.0  Xq.niqBqojcj 


o^ 

o 

• 

II 

<3 


00 

OJ 


SI 


II 

u 

o 

4-1 


0) 

o 

§ 


• 

in 

I 

m 

o 

u 

0 

O' 

•H 

Pm 


138 


TR  11123 


uoi;.33:).3Q  J.0  .1 1 1  qcqojd 


139 


TR  11123 


j.0  A^i[iq^qoJc| 


<N 

O 

if 

<J 


o 

00 

I 

CQ 

0) 

U 

o> 

•H 


uoii^39^9g  j.0  X:), I  [  1  q^qoj(j 


II 

<1 


CN 

iH 

IT) 

SI 


U 

o 

M-l 


(0 

a 

o 


I 

00 

0) 

u 

d 

•H 


140 


TR  11123 


UO\%OQ%BQ  iO 


CO 

O 

o 


<3 


CN 

o 


li 

p 

u 

o 

44 

CO 


U 

O 

o; 


• 

CN 

00 

I 

OQ 

0) 

U 

SJ 

a> 

•H 


141 


TR  11123 


’  6 
0 

E 

o 


o 

>% 


A 

0 

J3 

O 

CL 


UO^OO^OQ  J.O  1 


E 

&. 

0 

E 

0 

0 

a 

u. 


X 

•p 


M 

0 

JQ 

O 

c. 

£L 


uouoot).o[i  J.0 


142 


Figure  B-83.  ROCs  for  v**!,  M«*1024,  A=.006  Figure  B-84.  ROCs  for  v=l,  M®1024,  As.009 
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APPENDIX  C  -  COVARIANCE  COEFFICIENT  OF  TWO 
SEPARATED  EXCEEDANCE  DISTRIBUTION  ESTIMATES 

When  the  same  set  of  random  variables,  {x^l  for  1  <  n  <  N,  is 
used  to  estimate  the  exceedance  distribution  function  E(  )  at  two 
different  thresholds,  and  V2,  the  two  estimates  will  be 
correlated.  Here,  we  will  evaluate  the  covariance  coefficient 
between  two  such  estimates.  Without  loss  of  generality,  we 
assume  that  Vj^  -  "'^2* 

Let  {x^l  be  a  set  of  N  independent  identically  distributed 
random  variables  with  exceedance  distribution  function  E(v);  that 
is,  E(v)  =  Prob(Xj^  >  v).  Define  the  two  step  functions 

[1  for  X  >  V,  ] 

g.  (X)  =  ]  for  k  =  1  and  2  .  (C-1) 

io  otherwise  J 

Then,  the  fraction  of  the  number  of  times  that  exceeds 

threshold  Vj^  can  be  written  as 

1  N 

=  N  ^  ^k^^n^  for  k  =  1  and  2  .  (C-2) 

n=l 

Random  variable  qj^  is  an  estimate  of  E(Vj^);  in  fact,  its  mean 
value  is 

00 

qj^  =  i  N  gj^(x)  =  J  du  p(u)  gj^(u)  =  J  du  p(u)  =  E{Vj^)  ,  (C-3) 

^k 

where  p(u)  is  the  common  probability  density  function  of  random 
variables  Thus,  qj^  is  an  unbiased  estimate  of  E{Vj^). 
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The  mean  square  value  of  is  given  by 


N  m/n=l  N 


where  we  broke  the  double  sum  into  its  diagonal  versus  non¬ 
diagonal  terms,  and  used  the  independent  identically  distributed 
behavior  of  the  set  along  with  (C-1)  and  (C-3).  Combining 

this  result  with  (C-3),  the  variance  of  estimate  q^^  follows 
immediately  as 


2 

‘^l 


=  var(qj)  =  E(v^) 


1 


(C-5) 


which  is  a  familiar  result,  decaying  as  1/N. 

We  now  consider  the  crosscorrelation  between  estimates  q^  and 
q2,  both  using  the  same  data  values  this  is  given  by 


^2  ‘  92(-„)  =  4  i  92<*n)  ^ 

N  iti,n=l  iN  n—i 


N 


+  ^  LZ  E(Vi  )  E(V2)  =  ^  E(V2)  +  ^  E(v^)  E(V2)  .  (C-6) 

N  m,n=l 
m?^n 


Here  we  used  V2  >  which  gives  g2(^n)  52^^n)  "  E(V2). 

The  covariance  of  the  two  estimates  q^^  and  q2  follows  as 


=  1  E(V2)  [1  -  E(Vi)] 


(C-7) 


This  result  holds  only  for  V2  ^  v^;  that  is,  E(V2)  ^  E(v^). 
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It  will  be  observed  that  the  covariance  in  ( C-7 )  decays  as 
1/N.  However,  the  covariance  coefficient  is  given  by 


*^1  ^2  ~  *^1  ^2 
*^1  °2 


’E(V2) 

E(Vj^) 


[1  -  E(v^)]' 
[1  -  E(V2)] 


Js 


/ 


(C-8) 


which  is  independent  of  N,  the  number  of  trials.  Thus,  the  two 
different  estimates,  and  q2,  of  the  exceedance  distribution 
function  values  E(Vj^)  and  E(V2)  maintain  the  same  degree  of 
dependence,  regardless  of  the  number  of  trials  N  employed.  For 
two  thresholds  located  closely  together,  this  high  degree  of 
covariance  means  that  the  two  estimates  will  fluctuate  together, 
with  both  tending  to  be  high  or  both  tending  to  be  low  for  a 
particular  run  of  data  This  will  tend  to  make  a  plot  of 

the  sample  exceedance  distribution  function  versus  threshold  v 
look  smoother  than  it  really  should.  It  will  also  lead  to  sample 
receiver  operating  characteristics  with  a  smoother  appearance 
than  justified,  and  may  be  misleading  regarding  stability. 

Since  the  result  in  (C-8)  only  holds  for  v^  ^ 
have  E(V2)  i  E(Vj^)  and  1  -  E(v^)  <  1  -  E(V2),  giving  covariance 
coefficient  0  ^  p  <  1  in  all  cases.  Some  sample  values  for  p  are 
given  below.  For  small  exceedance  probabilities  E(Vj^)  and  E(V2), 
we  have  approximately  p  =  [E(V2  )/E(Vj^)  ]^. 


E(Vj) 

E(v2) 

P 

0.5 

0.4 

0.82 

0.5 

0.1 

0.33 

0.1 

0.01 

0.30 

0.002 

0.001 

0.71 

0.001 

0.0001 

0.32 
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The  characteristic  function  of  random  variable  in  (C-2)  is 
readily  calculated  in  the  form 

f^{l)  =  exp(i^qj)  =  [l  -  exp(i^/N)J  ,  (C-9) 

where  Ej^  =  k  =  1  and  2.  Expansion  of  (C-9)  in  a  power 

series  in  i^  quickly  verifies  (C-3)  -  (C-5).  The  probability 
density  function  of  q^^  contains  an  impulse  at  k/N  of  area 

(k)  ®1  for  0  <  k  <  N. 

The  joint  characteristic  function  of  random  variables  q^^  and 
q2  in  (C-2)  can  also  be  evaluated  in  the  closed  form 


f(^,h)  =  exp(i^q^  +  inq2)  =  exp[^  ^ 

(C-10) 

where 


=  J  du  p(u)  exp  gi(u)  +  92(^)  “ 


du  p(u) 


V 


1 


exp(^]  +  J  du  p(u) 


V. 


n"-^)  = 


-  1  -  Ej  +  (Ej  -  Ej)  exp(-i|)  +  Ej  exp(i^-±-iil]  .  (C-11) 

Expansion  of  (C-11)  in  a  joint  power  series  in  i^  and  ih  yields 
moments  that  are  consistent  with  (C-3)  -  (C-7).  The  joint 
density  of  q^^  and  q2  contains  an  impulse  at  Uj^  =  k/N,  U2  =  j/N, 
of  area 


(1  -  E^) 


N-k 


for  0  <  j  <  k  <  N  .  (C-12) 
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